2023-12-15 07:53:18,418 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-15 07:53:18,747 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-15 07:53:18,868 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-15 07:53:18,935 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 07:53:18,943 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-15 07:53:18,959 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=349, ProcessCount=169, AvailableMemoryMB=7558
2023-12-15 07:53:18,962 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 07:53:18,963 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-15 07:53:19,125 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1040924431:84 , srv1069478130:84 , srv1074274917:84 , srv1111407873:84 , srv1112258092:84 , srv1153703819:84 , srv1157221464:84 , srv1176555207:84 , srv1186888879:84 , srv1208697316:84 , srv1213455548:84 , srv122444260:84 , srv1242587556:84 , srv1288716849:84 , srv1312639829:84 , srv1314413681:84 , srv1321992049:84 , srv1372581470:84 , srv1388340931:84 , srv1414144715:84 , srv1417327730:84 , srv1432393277:84 , srv1447767621:84 , srv1511383919:84 , srv152971857:84 , srv1554880299:84 , srv1583451386:84 , srv1608158548:84 , srv161810261:84 , srv1636010008:84 , srv1658580066:84 , srv1663557534:84 , srv1663958729:84 , srv1716863949:84 , srv1741645073:84 , srv1769270534:84 , srv1826299562:84 , srv1878533754:84 , srv1882064197:84 , srv1903006205:84 , srv1907998166:84 , srv1926148273:84 , srv1942374200:84 , srv1960896109:84 , srv2007928407:84 , srv2014107929:84 , srv2039730496:84 , srv2054886996:84 , srv2057155582:84 , srv2080873006:84 , srv2093118387:84 , srv2108885053:84 , srv2122924415:84 , srv2143232288:84 , srv216742579:84 , srv233854329:84 , srv23667050:84 , srv27779530:84 , srv29080321:84 , srv305349311:84 , srv308653297:84 , srv314607759:84 , srv331168145:84 , srv333313421:84 , srv363520754:84 , srv37088450:84 , srv376281160:84 , srv407903588:84 , srv420079045:84 , srv429631046:84 , srv435532136:84 , srv447514055:84 , srv448120520:84 , srv513480461:84 , srv522628343:84 , srv527370741:84 , srv5642679:84 , srv564833975:84 , srv580222116:84 , srv591940131:84 , srv614650192:84 , srv618554709:84 , srv65579607:84 , srv665487954:84 , srv698983085:84 , srv709502670:84 , srv72082665:84 , srv727962832:84 , srv730072467:84 , srv790943223:84 , srv80325324:84 , srv818521926:84 , srv893643696:84 , srv902722569:84 , srv904089578:84 , srv926850161:84 , srv944892988:84 , srv987094107:84 , srv996790714:84 , srv325122327:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-15 07:53:19,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:19,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:19,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:19,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:19,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:19,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:19,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:19,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:19,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:19,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:19,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:19,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:19,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:19,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:19,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:19,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:19,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:19,248 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:19,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:19,249 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:19,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:19,444 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 07:53:19,445 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 07:53:19,867 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 595 ms to try 5000 different iterations.  Found a solution that moves 4694 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17773720775744115. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041525349579359244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05163108365221605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5215555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041525349579359244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:19,884 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1608158548:82 , srv1663958729:82 , srv1716863949:82 , srv1907998166:82 , srv2054886996:82 , srv363520754:82 , srv448120520:82 , srv1153703819:83 , srv1414144715:83 , srv1554880299:83 , srv1636010008:83 , srv1926148273:83 , srv1942374200:83 , srv2080873006:83 , srv27779530:83 , srv333313421:83 , srv37088450:83 , srv435532136:83 , srv522628343:83 , srv1040924431:84 , srv2108885053:84 , srv308653297:84 , srv447514055:84 , srv564833975:84 , srv580222116:84 , srv618554709:84 , srv65579607:84 , srv698983085:84 , srv926850161:84 , srv1069478130:85 , srv122444260:85 , srv1372581470:85 , srv1903006205:85 , srv23667050:85 , srv513480461:85 , srv5642679:85 , srv730072467:85 , srv893643696:85 , srv996790714:85 , srv1242587556:86 , srv1321992049:86 , srv1432393277:86 , srv152971857:86 , srv161810261:86 , srv1960896109:86 , srv2007928407:86 , srv2039730496:86 , srv29080321:86 , srv305349311:86 , srv407903588:86 , srv591940131:86 , srv665487954:86 , srv818521926:86 , srv1111407873:87 , srv1208697316:87 , srv1312639829:87 , srv1314413681:87 , srv1447767621:87 , srv1663557534:87 , srv1769270534:87 , srv1826299562:87 , srv1882064197:87 , srv2014107929:87 , srv2122924415:87 , srv216742579:87 , srv420079045:87 , srv709502670:87 , srv902722569:87 , srv944892988:87 , srv1112258092:88 , srv233854329:88 , srv314607759:88 , srv429631046:88 , srv527370741:88 , srv614650192:88 , srv72082665:88 , srv727962832:88 , srv790943223:88 , srv904089578:88 , srv987094107:88 , srv1176555207:89 , srv1186888879:89 , srv1288716849:89 , srv1417327730:89 , srv1658580066:89 , srv1741645073:89 , srv2057155582:89 , srv2143232288:89 , srv376281160:89 , srv1074274917:90 , srv1878533754:90 , srv2093118387:90 , srv1157221464:91 , srv1583451386:91 , srv1213455548:92 , srv1511383919:92 , srv80325324:92 , srv1388340931:93 , srv331168145:95 , srv325122327:459 }
2023-12-15 07:53:19,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:19,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:19,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:19,906 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:19,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:19,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:19,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:19,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:19,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:19,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:20,061 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041525349579359244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05163108365221605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041525349579359244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:20,061 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 07:53:20,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17770433966693736, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041525349579359244, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05163108365221605, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041525349579359244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17266666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 07:53:20,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 475 ms to try 5000 different iterations.  Found a solution that moves 2647 regions; Going from a computed imbalance of 0.17770433966693736 to a new imbalance of 0.014872600632939345. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030098976271877406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2941111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:20,427 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv331168145:75 , srv1511383919:79 , srv80325324:79 , srv1213455548:80 , srv1583451386:80 , srv1658580066:80 , srv1176555207:81 , srv1388340931:81 , srv233854329:81 , srv1741645073:82 , srv1878533754:82 , srv376281160:82 , srv1074274917:83 , srv1157221464:83 , srv1417327730:83 , srv1447767621:83 , srv161810261:83 , srv2093118387:83 , srv790943223:83 , srv1069478130:84 , srv1112258092:84 , srv1186888879:84 , srv1769270534:84 , srv2122924415:84 , srv420079045:84 , srv429631046:84 , srv614650192:84 , srv709502670:84 , srv987094107:84 , srv1111407873:85 , srv1208697316:85 , srv1321992049:85 , srv1663557534:85 , srv2014107929:85 , srv2039730496:85 , srv2057155582:85 , srv2143232288:85 , srv216742579:85 , srv305349311:85 , srv314607759:85 , srv513480461:85 , srv527370741:85 , srv591940131:85 , srv72082665:85 , srv902722569:85 , srv944892988:85 , srv1288716849:86 , srv1312639829:86 , srv1314413681:86 , srv1903006205:86 , srv1960896109:86 , srv580222116:86 , srv65579607:86 , srv698983085:86 , srv727962832:86 , srv904089578:86 , srv1242587556:87 , srv1432393277:87 , srv152971857:87 , srv1554880299:87 , srv1826299562:87 , srv1942374200:87 , srv2007928407:87 , srv2108885053:87 , srv23667050:87 , srv29080321:87 , srv37088450:87 , srv407903588:87 , srv5642679:87 , srv564833975:87 , srv730072467:87 , srv1040924431:88 , srv122444260:88 , srv1372581470:88 , srv2054886996:88 , srv27779530:88 , srv308653297:88 , srv618554709:88 , srv996790714:88 , srv1153703819:89 , srv1414144715:89 , srv1608158548:89 , srv1882064197:89 , srv1926148273:89 , srv447514055:89 , srv522628343:89 , srv665487954:89 , srv893643696:89 , srv926850161:89 , srv1636010008:90 , srv1907998166:90 , srv2080873006:90 , srv333313421:90 , srv363520754:90 , srv818521926:90 , srv1663958729:91 , srv435532136:91 , srv448120520:91 , srv1716863949:93 , srv325122327:507 }
2023-12-15 07:53:20,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:20,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:20,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:20,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:20,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:20,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:20,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:20,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:20,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:20,568 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030098976271877406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:20,568 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 07:53:20,568 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014854065942789468, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030098976271877406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 07:53:20,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 348 ms to try 5000 different iterations.  Found a solution that moves 948 regions; Going from a computed imbalance of 0.014854065942789468 to a new imbalance of 9.66451467528861E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.10533333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:20,820 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1882064197:82 , srv665487954:82 , srv818521926:82 , srv1157221464:83 , srv1288716849:83 , srv1388340931:83 , srv1716863949:83 , srv29080321:83 , srv435532136:83 , srv1074274917:84 , srv122444260:84 , srv1372581470:84 , srv1432393277:84 , srv1663958729:84 , srv1826299562:84 , srv2007928407:84 , srv2057155582:84 , srv2093118387:84 , srv2143232288:84 , srv333313421:84 , srv447514055:84 , srv527370741:84 , srv727962832:84 , srv893643696:84 , srv904089578:84 , srv1040924431:85 , srv1111407873:85 , srv1112258092:85 , srv1153703819:85 , srv1186888879:85 , srv1208697316:85 , srv1242587556:85 , srv1314413681:85 , srv152971857:85 , srv1636010008:85 , srv1907998166:85 , srv1960896109:85 , srv2080873006:85 , srv23667050:85 , srv314607759:85 , srv407903588:85 , srv448120520:85 , srv522628343:85 , srv614650192:85 , srv618554709:85 , srv72082665:85 , srv730072467:85 , srv902722569:85 , srv926850161:85 , srv944892988:85 , srv987094107:85 , srv996790714:85 , srv1213455548:86 , srv1312639829:86 , srv1321992049:86 , srv1414144715:86 , srv1417327730:86 , srv1583451386:86 , srv1608158548:86 , srv1663557534:86 , srv1769270534:86 , srv1878533754:86 , srv1903006205:86 , srv1926148273:86 , srv2014107929:86 , srv216742579:86 , srv308653297:86 , srv331168145:86 , srv363520754:86 , srv376281160:86 , srv420079045:86 , srv429631046:86 , srv564833975:86 , srv709502670:86 , srv790943223:86 , srv80325324:86 , srv1176555207:87 , srv1447767621:87 , srv1511383919:87 , srv1942374200:87 , srv2039730496:87 , srv2054886996:87 , srv2108885053:87 , srv2122924415:87 , srv27779530:87 , srv305349311:87 , srv513480461:87 , srv5642679:87 , srv580222116:87 , srv591940131:87 , srv65579607:87 , srv1069478130:88 , srv1554880299:88 , srv161810261:88 , srv1658580066:88 , srv1741645073:88 , srv233854329:88 , srv698983085:88 , srv37088450:89 , srv325122327:543 }
2023-12-15 07:53:20,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:20,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:20,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:20,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:20,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:20,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:20,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:20,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:20,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:20,950 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:20,950 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 07:53:20,950 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.598134296512327E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005763774795025093); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 07:53:21,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 245 regions; Going from a computed imbalance of 9.598134296512327E-4 to a new imbalance of 2.710520782709647E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.02722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:21,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1741645073:82 , srv37088450:82 , srv1312639829:83 , srv5642679:83 , srv1074274917:84 , srv1157221464:84 , srv1186888879:84 , srv1213455548:84 , srv1288716849:84 , srv1314413681:84 , srv1388340931:84 , srv1414144715:84 , srv1417327730:84 , srv1511383919:84 , srv1554880299:84 , srv1583451386:84 , srv1716863949:84 , srv1826299562:84 , srv1878533754:84 , srv1882064197:84 , srv1926148273:84 , srv1942374200:84 , srv2014107929:84 , srv2039730496:84 , srv2054886996:84 , srv2057155582:84 , srv2080873006:84 , srv2108885053:84 , srv2122924415:84 , srv2143232288:84 , srv216742579:84 , srv27779530:84 , srv305349311:84 , srv308653297:84 , srv314607759:84 , srv363520754:84 , srv407903588:84 , srv429631046:84 , srv448120520:84 , srv564833975:84 , srv591940131:84 , srv618554709:84 , srv698983085:84 , srv72082665:84 , srv727962832:84 , srv818521926:84 , srv893643696:84 , srv904089578:84 , srv926850161:84 , srv1040924431:85 , srv1069478130:85 , srv1111407873:85 , srv1112258092:85 , srv1153703819:85 , srv1176555207:85 , srv122444260:85 , srv1242587556:85 , srv1321992049:85 , srv1372581470:85 , srv1432393277:85 , srv1447767621:85 , srv152971857:85 , srv1608158548:85 , srv161810261:85 , srv1636010008:85 , srv1658580066:85 , srv1663557534:85 , srv1903006205:85 , srv1907998166:85 , srv1960896109:85 , srv2007928407:85 , srv2093118387:85 , srv23667050:85 , srv333313421:85 , srv376281160:85 , srv420079045:85 , srv435532136:85 , srv447514055:85 , srv513480461:85 , srv522628343:85 , srv527370741:85 , srv580222116:85 , srv614650192:85 , srv65579607:85 , srv665487954:85 , srv709502670:85 , srv730072467:85 , srv790943223:85 , srv80325324:85 , srv902722569:85 , srv987094107:85 , srv996790714:85 , srv1208697316:86 , srv1663958729:86 , srv1769270534:86 , srv233854329:86 , srv29080321:86 , srv331168145:86 , srv944892988:86 , srv325122327:633 }
2023-12-15 07:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:21,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:21,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:21,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:21,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:21,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:21,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:21,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:21,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:21,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:21,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:21,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:21,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:21,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:21,429 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:21,429 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-15 07:53:21,429 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.53896811604098E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-15 07:53:21,660 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 325 ms to try 5000 different iterations.  Found a solution that moves 26 regions; Going from a computed imbalance of 2.53896811604098E-5 to a new imbalance of 6.2141346308869544E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0028888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:21,660 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1208697316:83 , srv1242587556:83 , srv152971857:83 , srv1636010008:83 , srv1663557534:83 , srv1663958729:83 , srv1769270534:83 , srv233854329:83 , srv944892988:83 , srv996790714:83 , srv1040924431:84 , srv1069478130:84 , srv1111407873:84 , srv1112258092:84 , srv1153703819:84 , srv1176555207:84 , srv1186888879:84 , srv1213455548:84 , srv122444260:84 , srv1288716849:84 , srv1312639829:84 , srv1314413681:84 , srv1321992049:84 , srv1372581470:84 , srv1414144715:84 , srv1417327730:84 , srv1432393277:84 , srv1447767621:84 , srv1511383919:84 , srv1554880299:84 , srv1608158548:84 , srv161810261:84 , srv1658580066:84 , srv1716863949:84 , srv1826299562:84 , srv1878533754:84 , srv1882064197:84 , srv1903006205:84 , srv1907998166:84 , srv1926148273:84 , srv1960896109:84 , srv2007928407:84 , srv2014107929:84 , srv2039730496:84 , srv2057155582:84 , srv2080873006:84 , srv2093118387:84 , srv2108885053:84 , srv2122924415:84 , srv2143232288:84 , srv216742579:84 , srv23667050:84 , srv27779530:84 , srv29080321:84 , srv305349311:84 , srv308653297:84 , srv314607759:84 , srv331168145:84 , srv333313421:84 , srv363520754:84 , srv376281160:84 , srv407903588:84 , srv420079045:84 , srv429631046:84 , srv435532136:84 , srv447514055:84 , srv448120520:84 , srv513480461:84 , srv522628343:84 , srv527370741:84 , srv5642679:84 , srv580222116:84 , srv591940131:84 , srv614650192:84 , srv65579607:84 , srv665487954:84 , srv698983085:84 , srv709502670:84 , srv72082665:84 , srv727962832:84 , srv730072467:84 , srv790943223:84 , srv80325324:84 , srv818521926:84 , srv893643696:84 , srv902722569:84 , srv904089578:84 , srv926850161:84 , srv987094107:84 , srv1074274917:85 , srv1157221464:85 , srv1388340931:85 , srv1583451386:85 , srv1741645073:85 , srv1942374200:85 , srv2054886996:85 , srv37088450:85 , srv564833975:85 , srv618554709:85 , srv325122327:684 }
2023-12-15 07:53:21,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:21,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1414144715=19, srv1040924431=0, srv1663557534=31, srv2057155582=48, srv2143232288=53, srv2122924415=52, srv1157221464=6, srv1176555207=7, srv1069478130=1, srv216742579=54, srv665487954=84, srv1447767621=22, srv1321992049=16, srv1432393277=21, srv2039730496=46, srv987094107=98, srv1942374200=42, srv1960896109=43, srv325122327=62, srv435532136=71, srv65579607=83, srv1716863949=33, srv407903588=68, srv522628343=75, srv996790714=99, srv376281160=67, srv1926148273=41, srv1372581470=17, srv1242587556=12, srv2054886996=47, srv1878533754=37, srv1111407873=3, srv23667050=56, srv1907998166=40, srv1208697316=9, srv331168145=63, srv80325324=91, srv2014107929=45, srv698983085=85, srv1074274917=2, srv709502670=86, srv1663958729=32, srv1112258092=4, srv1741645073=34, srv5642679=77, srv2007928407=44, srv730072467=89, srv1153703819=5, srv926850161=96, srv1903006205=39, srv513480461=74, srv527370741=76, srv152971857=24, srv2093118387=50, srv1511383919=23, srv333313421=64, srv1213455548=10, srv1769270534=35, srv37088450=66, srv727962832=88, srv1314413681=15, srv1882064197=38, srv2080873006=49, srv818521926=92, srv122444260=11, srv618554709=82, srv893643696=93, srv1186888879=8, srv944892988=97, srv1312639829=14, srv420079045=69, srv448120520=73, srv580222116=79, srv27779530=57, srv1826299562=36, srv29080321=58, srv161810261=28, srv790943223=90, srv1388340931=18, srv447514055=72, srv1583451386=26, srv2108885053=51, srv1417327730=20, srv1658580066=30, srv233854329=55, srv363520754=65, srv902722569=94, srv1608158548=27, srv314607759=61, srv1554880299=25, srv591940131=80, srv614650192=81, srv1288716849=13, srv429631046=70, srv72082665=87, srv1636010008=29, srv564833975=78, srv904089578=95, srv305349311=59, srv308653297=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:21,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:21,683 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-15 07:53:21,684 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-15 07:53:21,685 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-15 07:53:21,686 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-15 07:53:21,687 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-15 07:53:21,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:21,790 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1208697316:83 , srv1242587556:83 , srv152971857:83 , srv1636010008:83 , srv1663557534:83 , srv1663958729:83 , srv1769270534:83 , srv233854329:83 , srv944892988:83 , srv996790714:83 , srv1040924431:84 , srv1069478130:84 , srv1111407873:84 , srv1112258092:84 , srv1153703819:84 , srv1176555207:84 , srv1186888879:84 , srv1213455548:84 , srv122444260:84 , srv1288716849:84 , srv1312639829:84 , srv1314413681:84 , srv1321992049:84 , srv1372581470:84 , srv1414144715:84 , srv1417327730:84 , srv1432393277:84 , srv1447767621:84 , srv1511383919:84 , srv1554880299:84 , srv1608158548:84 , srv161810261:84 , srv1658580066:84 , srv1716863949:84 , srv1826299562:84 , srv1878533754:84 , srv1882064197:84 , srv1903006205:84 , srv1907998166:84 , srv1926148273:84 , srv1960896109:84 , srv2007928407:84 , srv2014107929:84 , srv2039730496:84 , srv2057155582:84 , srv2080873006:84 , srv2093118387:84 , srv2108885053:84 , srv2122924415:84 , srv2143232288:84 , srv216742579:84 , srv23667050:84 , srv27779530:84 , srv29080321:84 , srv305349311:84 , srv308653297:84 , srv314607759:84 , srv331168145:84 , srv333313421:84 , srv363520754:84 , srv376281160:84 , srv407903588:84 , srv420079045:84 , srv429631046:84 , srv435532136:84 , srv447514055:84 , srv448120520:84 , srv513480461:84 , srv522628343:84 , srv527370741:84 , srv5642679:84 , srv580222116:84 , srv591940131:84 , srv614650192:84 , srv65579607:84 , srv665487954:84 , srv698983085:84 , srv709502670:84 , srv72082665:84 , srv727962832:84 , srv730072467:84 , srv790943223:84 , srv80325324:84 , srv818521926:84 , srv893643696:84 , srv902722569:84 , srv904089578:84 , srv926850161:84 , srv987094107:84 , srv1074274917:85 , srv1157221464:85 , srv1388340931:85 , srv1583451386:85 , srv1741645073:85 , srv1942374200:85 , srv2054886996:85 , srv37088450:85 , srv564833975:85 , srv618554709:85 , srv325122327:684 }
2023-12-15 07:53:21,815 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=361 (was 349) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=6950 (was 7558)
2023-12-15 07:53:21,822 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=361, ProcessCount=169, AvailableMemoryMB=6950
2023-12-15 07:53:21,823 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-15 07:53:21,823 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-15 07:53:21,836 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv105868390:84 , srv1090586780:84 , srv1115579099:84 , srv1275163693:84 , srv1285011441:84 , srv1313415888:84 , srv1421851069:84 , srv1687243283:84 , srv1718066598:84 , srv173407475:84 , srv1773241735:84 , srv189573343:84 , srv1969569944:84 , srv2006279189:84 , srv2084937087:84 , srv2098236971:84 , srv2100596565:84 , srv210603446:84 , srv234555558:84 , srv40338728:84 , srv429324647:84 , srv45976366:84 , srv505247962:84 , srv566553064:84 , srv605427779:84 , srv843035384:84 , srv962611619:84 , srv982835524:84 , srv992041205:84 , srv303845537:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-15 07:53:21,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv605427779=25, srv962611619=27, srv1313415888=5, srv429324647=21, srv1421851069=6, srv40338728=20, srv2006279189=13, srv210603446=17, srv45976366=22, srv982835524=28, srv505247962=23, srv1969569944=12, srv992041205=29, srv1285011441=4, srv1275163693=3, srv843035384=26, srv2084937087=14, srv303845537=19, srv1687243283=7, srv1773241735=10, srv234555558=18, srv189573343=11, srv105868390=0, srv1115579099=2, srv566553064=24, srv1090586780=1, srv2098236971=15, srv2100596565=16, srv1718066598=8, srv173407475=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:53:21,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:53:21,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-15 07:53:21,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0809749747845991, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:53:21,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991244819276575, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0809749747845991, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-15 07:55:21,851 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5613753 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.991244819276575 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:55:21,858 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv105868390:90 , srv1090586780:90 , srv1115579099:90 , srv1275163693:90 , srv1285011441:90 , srv1313415888:90 , srv1421851069:90 , srv1687243283:90 , srv1718066598:90 , srv173407475:90 , srv1773241735:90 , srv189573343:90 , srv1969569944:90 , srv2006279189:90 , srv2084937087:90 , srv2098236971:90 , srv2100596565:90 , srv210603446:90 , srv234555558:90 , srv303845537:90 , srv40338728:90 , srv429324647:90 , srv45976366:90 , srv505247962:90 , srv566553064:90 , srv605427779:90 , srv843035384:90 , srv962611619:90 , srv982835524:90 , srv992041205:90 }
2023-12-15 07:55:21,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-15 07:55:21,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv605427779=25, srv962611619=27, srv1313415888=5, srv429324647=21, srv1421851069=6, srv40338728=20, srv2006279189=13, srv210603446=17, srv45976366=22, srv982835524=28, srv505247962=23, srv1969569944=12, srv992041205=29, srv1285011441=4, srv1275163693=3, srv843035384=26, srv2084937087=14, srv303845537=19, srv1687243283=7, srv1773241735=10, srv234555558=18, srv189573343=11, srv105868390=0, srv1115579099=2, srv566553064=24, srv1090586780=1, srv2098236971=15, srv2100596565=16, srv1718066598=8, srv173407475=9} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-15 07:55:21,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-15 07:55:21,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-15 07:55:21,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-15 07:55:21,882 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv105868390:90 , srv1090586780:90 , srv1115579099:90 , srv1275163693:90 , srv1285011441:90 , srv1313415888:90 , srv1421851069:90 , srv1687243283:90 , srv1718066598:90 , srv173407475:90 , srv1773241735:90 , srv189573343:90 , srv1969569944:90 , srv2006279189:90 , srv2084937087:90 , srv2098236971:90 , srv2100596565:90 , srv210603446:90 , srv234555558:90 , srv303845537:90 , srv40338728:90 , srv429324647:90 , srv45976366:90 , srv505247962:90 , srv566553064:90 , srv605427779:90 , srv843035384:90 , srv962611619:90 , srv982835524:90 , srv992041205:90 }
2023-12-15 07:55:21,897 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=352 (was 361), ProcessCount=169 (was 169), AvailableMemoryMB=5846 (was 6950)