2023-09-04 21:53:11,986 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-04 21:53:12,315 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-04 21:53:12,432 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-04 21:53:12,497 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 21:53:12,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-04 21:53:12,524 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=169, AvailableMemoryMB=10133
2023-09-04 21:53:12,526 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 21:53:12,527 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-04 21:53:12,678 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv10112193:84 , srv1038729615:84 , srv106433242:84 , srv1081477302:84 , srv1114189153:84 , srv1118137515:84 , srv1134342389:84 , srv1138274407:84 , srv1160448194:84 , srv1207977208:84 , srv1209783667:84 , srv1232703203:84 , srv1237948870:84 , srv127083316:84 , srv1271933825:84 , srv1285999293:84 , srv1293199351:84 , srv1312006267:84 , srv1371328091:84 , srv1373339837:84 , srv1400363179:84 , srv1406061524:84 , srv1457758451:84 , srv1479195164:84 , srv1502859962:84 , srv1516027138:84 , srv1516952500:84 , srv1542866730:84 , srv1575840172:84 , srv1607726941:84 , srv1609109008:84 , srv1624875017:84 , srv1656611270:84 , srv1656717256:84 , srv1691324474:84 , srv1708498740:84 , srv171199165:84 , srv1717173482:84 , srv173507742:84 , srv1762916065:84 , srv1767961624:84 , srv1783858506:84 , srv1790449334:84 , srv1807501835:84 , srv1830604051:84 , srv1855837037:84 , srv1894520766:84 , srv1924093900:84 , srv194574828:84 , srv1960288822:84 , srv1976748625:84 , srv200719763:84 , srv2012648849:84 , srv2066900666:84 , srv208235169:84 , srv2110818955:84 , srv2119290390:84 , srv215062711:84 , srv242194565:84 , srv258191024:84 , srv346082902:84 , srv367698186:84 , srv43929050:84 , srv440215616:84 , srv461540211:84 , srv483917511:84 , srv494409003:84 , srv509987112:84 , srv510123871:84 , srv520909766:84 , srv574330285:84 , srv576911209:84 , srv602689276:84 , srv650881141:84 , srv654158325:84 , srv655055890:84 , srv671181455:84 , srv684052102:84 , srv703076053:84 , srv729293915:84 , srv729862846:84 , srv737971578:84 , srv780115192:84 , srv780771459:84 , srv790352137:84 , srv810761052:84 , srv860606664:84 , srv875075272:84 , srv875705356:84 , srv884294288:84 , srv893100102:84 , srv897350431:84 , srv904278588:84 , srv936904867:84 , srv951341080:84 , srv951638659:84 , srv954717009:84 , srv962048164:84 , srv979102513:84 , srv1589559279:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-04 21:53:12,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:12,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924093900=48, srv1160448194=8, srv520909766=70, srv2119290390=57, srv461540211=65, srv1081477302=3, srv729293915=80, srv936904867=94, srv494409003=67, srv671181455=77, srv703076053=79, srv576911209=72, srv1373339837=19, srv509987112=68, srv1609109008=31, srv655055890=76, srv10112193=0, srv242194565=59, srv346082902=61, srv1400363179=20, srv127083316=13, srv1717173482=38, srv1209783667=10, srv954717009=97, srv737971578=82, srv1691324474=35, srv1232703203=11, srv962048164=98, srv1767961624=41, srv1807501835=44, srv1406061524=21, srv1502859962=24, srv2110818955=56, srv1271933825=14, srv1855837037=46, srv1589559279=29, srv1038729615=1, srv1118137515=5, srv650881141=74, srv1656717256=34, srv780771459=84, srv951638659=96, srv602689276=73, srv173507742=39, srv1237948870=12, srv1976748625=51, srv367698186=62, srv194574828=49, srv979102513=99, srv43929050=63, srv1575840172=28, srv1138274407=7, srv729862846=81, srv1783858506=42, srv1762916065=40, srv1207977208=9, srv904278588=93, srv1516027138=25, srv1790449334=43, srv2066900666=54, srv875705356=89, srv951341080=95, srv1285999293=15, srv1708498740=36, srv171199165=37, srv860606664=87, srv897350431=92, srv1830604051=45, srv574330285=71, srv1114189153=4, srv2012648849=53, srv875075272=88, srv440215616=64, srv790352137=85, srv200719763=52, srv1457758451=22, srv1607726941=30, srv106433242=2, srv1371328091=18, srv1894520766=47, srv1960288822=50, srv1542866730=27, srv1656611270=33, srv893100102=91, srv1624875017=32, srv1516952500=26, srv654158325=75, srv780115192=83, srv208235169=55, srv258191024=60, srv884294288=90, srv1479195164=23, srv215062711=58, srv510123871=69, srv1293199351=16, srv483917511=66, srv1312006267=17, srv810761052=86, srv1134342389=6, srv684052102=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:12,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:12,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:12,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:12,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:12,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:12,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 21:53:12,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 21:53:12,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 21:53:12,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 21:53:12,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 21:53:12,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 21:53:12,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 21:53:12,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 21:53:13,057 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:13,058 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 21:53:13,058 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 21:53:13,467 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 662 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18364414037133914. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813556067051225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055855754581469214, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813556067051225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17891666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:13,483 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1134342389:83 , srv1502859962:83 , srv1609109008:83 , srv483917511:83 , srv951341080:83 , srv1232703203:84 , srv1271933825:84 , srv1293199351:84 , srv1656717256:84 , srv1762916065:84 , srv1783858506:84 , srv194574828:84 , srv200719763:84 , srv2110818955:84 , srv215062711:84 , srv367698186:84 , srv520909766:84 , srv574330285:84 , srv602689276:84 , srv671181455:84 , srv703076053:84 , srv737971578:84 , srv875075272:84 , srv936904867:84 , srv962048164:84 , srv10112193:85 , srv1160448194:85 , srv1400363179:85 , srv1575840172:85 , srv1607726941:85 , srv1691324474:85 , srv1830604051:85 , srv258191024:85 , srv43929050:85 , srv810761052:85 , srv893100102:85 , srv1114189153:86 , srv1138274407:86 , srv1209783667:86 , srv1237948870:86 , srv1285999293:86 , srv1457758451:86 , srv1516027138:86 , srv1855837037:86 , srv2012648849:86 , srv461540211:86 , srv684052102:86 , srv884294288:86 , srv897350431:86 , srv904278588:86 , srv1118137515:87 , srv1207977208:87 , srv127083316:87 , srv1371328091:87 , srv1479195164:87 , srv1542866730:87 , srv1624875017:87 , srv1708498740:87 , srv173507742:87 , srv1790449334:87 , srv1960288822:87 , srv242194565:87 , srv494409003:87 , srv510123871:87 , srv780115192:87 , srv106433242:88 , srv1406061524:88 , srv1516952500:88 , srv1656611270:88 , srv1717173482:88 , srv1767961624:88 , srv1807501835:88 , srv208235169:88 , srv346082902:88 , srv440215616:88 , srv576911209:88 , srv650881141:88 , srv729293915:88 , srv780771459:88 , srv860606664:88 , srv951638659:88 , srv1081477302:89 , srv1373339837:89 , srv1894520766:89 , srv655055890:89 , srv790352137:89 , srv875705356:89 , srv1038729615:90 , srv1924093900:90 , srv1976748625:90 , srv2066900666:90 , srv509987112:90 , srv729862846:90 , srv979102513:90 , srv171199165:91 , srv2119290390:91 , srv654158325:91 , srv1312006267:92 , srv954717009:95 , srv1589559279:429 }
2023-09-04 21:53:13,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:13,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924093900=48, srv1160448194=8, srv520909766=70, srv2119290390=57, srv461540211=65, srv1081477302=3, srv729293915=80, srv936904867=94, srv494409003=67, srv671181455=77, srv703076053=79, srv576911209=72, srv1373339837=19, srv509987112=68, srv1609109008=31, srv655055890=76, srv10112193=0, srv242194565=59, srv346082902=61, srv1400363179=20, srv127083316=13, srv1717173482=38, srv1209783667=10, srv954717009=97, srv737971578=82, srv1691324474=35, srv1232703203=11, srv962048164=98, srv1767961624=41, srv1807501835=44, srv1406061524=21, srv1502859962=24, srv2110818955=56, srv1271933825=14, srv1855837037=46, srv1589559279=29, srv1038729615=1, srv1118137515=5, srv650881141=74, srv1656717256=34, srv780771459=84, srv951638659=96, srv602689276=73, srv173507742=39, srv1237948870=12, srv1976748625=51, srv367698186=62, srv194574828=49, srv979102513=99, srv43929050=63, srv1575840172=28, srv1138274407=7, srv729862846=81, srv1783858506=42, srv1762916065=40, srv1207977208=9, srv904278588=93, srv1516027138=25, srv1790449334=43, srv2066900666=54, srv875705356=89, srv951341080=95, srv1285999293=15, srv1708498740=36, srv171199165=37, srv860606664=87, srv897350431=92, srv1830604051=45, srv574330285=71, srv1114189153=4, srv2012648849=53, srv875075272=88, srv440215616=64, srv790352137=85, srv200719763=52, srv1457758451=22, srv1607726941=30, srv106433242=2, srv1371328091=18, srv1894520766=47, srv1960288822=50, srv1542866730=27, srv1656611270=33, srv893100102=91, srv1624875017=32, srv1516952500=26, srv654158325=75, srv780115192=83, srv208235169=55, srv258191024=60, srv884294288=90, srv1479195164=23, srv215062711=58, srv510123871=69, srv1293199351=16, srv483917511=66, srv1312006267=17, srv810761052=86, srv1134342389=6, srv684052102=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:13,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:13,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:13,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:13,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 21:53:13,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 21:53:13,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 21:53:13,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 21:53:13,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 21:53:13,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 21:53:13,518 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 21:53:13,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 21:53:13,696 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813556067051225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055855754581469214, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813556067051225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17891666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:13,696 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 21:53:13,696 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18361134230233195, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03813556067051225, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055855754581469214, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03813556067051225, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17891666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 21:53:14,019 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 477 ms to try 5000 different iterations.  Found a solution that moves 2684 regions; Going from a computed imbalance of 0.18361134230233195 to a new imbalance of 0.015351144013083433. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093463958503778); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038742871615435284, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2982222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093463958503778); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:14,041 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv171199165:79 , srv954717009:79 , srv729862846:80 , srv1312006267:81 , srv2066900666:81 , srv2119290390:81 , srv509987112:81 , srv790352137:81 , srv875705356:81 , srv1894520766:82 , srv655055890:82 , srv729293915:82 , srv979102513:82 , srv1038729615:83 , srv1371328091:83 , srv1516952500:83 , srv1624875017:83 , srv1708498740:83 , srv1924093900:83 , srv346082902:83 , srv780771459:83 , srv106433242:84 , srv1656611270:84 , srv1717173482:84 , srv1767961624:84 , srv1807501835:84 , srv440215616:84 , srv576911209:84 , srv860606664:84 , srv884294288:84 , srv1081477302:85 , srv1114189153:85 , srv1207977208:85 , srv127083316:85 , srv1406061524:85 , srv1516027138:85 , srv1542866730:85 , srv1691324474:85 , srv173507742:85 , srv1960288822:85 , srv1976748625:85 , srv2012648849:85 , srv461540211:85 , srv494409003:85 , srv737971578:85 , srv951638659:85 , srv1118137515:86 , srv1160448194:86 , srv1237948870:86 , srv1271933825:86 , srv1373339837:86 , srv1457758451:86 , srv1479195164:86 , srv2110818955:86 , srv242194565:86 , srv510123871:86 , srv650881141:86 , srv654158325:86 , srv893100102:86 , srv897350431:86 , srv904278588:86 , srv936904867:86 , srv10112193:87 , srv1138274407:87 , srv1209783667:87 , srv1232703203:87 , srv1285999293:87 , srv1293199351:87 , srv1400363179:87 , srv1790449334:87 , srv200719763:87 , srv208235169:87 , srv258191024:87 , srv684052102:87 , srv780115192:87 , srv1134342389:88 , srv1575840172:88 , srv1656717256:88 , srv1830604051:88 , srv1855837037:88 , srv194574828:88 , srv43929050:88 , srv483917511:88 , srv520909766:88 , srv671181455:88 , srv810761052:88 , srv875075272:88 , srv1502859962:89 , srv1607726941:89 , srv1609109008:89 , srv367698186:89 , srv602689276:89 , srv703076053:89 , srv962048164:89 , srv1762916065:90 , srv1783858506:90 , srv215062711:90 , srv574330285:90 , srv951341080:91 , srv1589559279:531 }
2023-09-04 21:53:14,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:14,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924093900=48, srv1160448194=8, srv520909766=70, srv2119290390=57, srv461540211=65, srv1081477302=3, srv729293915=80, srv936904867=94, srv494409003=67, srv671181455=77, srv703076053=79, srv576911209=72, srv1373339837=19, srv509987112=68, srv1609109008=31, srv655055890=76, srv10112193=0, srv242194565=59, srv346082902=61, srv1400363179=20, srv127083316=13, srv1717173482=38, srv1209783667=10, srv954717009=97, srv737971578=82, srv1691324474=35, srv1232703203=11, srv962048164=98, srv1767961624=41, srv1807501835=44, srv1406061524=21, srv1502859962=24, srv2110818955=56, srv1271933825=14, srv1855837037=46, srv1589559279=29, srv1038729615=1, srv1118137515=5, srv650881141=74, srv1656717256=34, srv780771459=84, srv951638659=96, srv602689276=73, srv173507742=39, srv1237948870=12, srv1976748625=51, srv367698186=62, srv194574828=49, srv979102513=99, srv43929050=63, srv1575840172=28, srv1138274407=7, srv729862846=81, srv1783858506=42, srv1762916065=40, srv1207977208=9, srv904278588=93, srv1516027138=25, srv1790449334=43, srv2066900666=54, srv875705356=89, srv951341080=95, srv1285999293=15, srv1708498740=36, srv171199165=37, srv860606664=87, srv897350431=92, srv1830604051=45, srv574330285=71, srv1114189153=4, srv2012648849=53, srv875075272=88, srv440215616=64, srv790352137=85, srv200719763=52, srv1457758451=22, srv1607726941=30, srv106433242=2, srv1371328091=18, srv1894520766=47, srv1960288822=50, srv1542866730=27, srv1656611270=33, srv893100102=91, srv1624875017=32, srv1516952500=26, srv654158325=75, srv780115192=83, srv208235169=55, srv258191024=60, srv884294288=90, srv1479195164=23, srv215062711=58, srv510123871=69, srv1293199351=16, srv483917511=66, srv1312006267=17, srv810761052=86, srv1134342389=6, srv684052102=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:14,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 21:53:14,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 21:53:14,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 21:53:14,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 21:53:14,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 21:53:14,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 21:53:14,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 21:53:14,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 21:53:14,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 21:53:14,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 21:53:14,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093463958503778); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038742871615435284, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093463958503778); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:14,242 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 21:53:14,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015332350243396138, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093463958503778); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038742871615435284, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093463958503778); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 21:53:14,535 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 429 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.015332350243396138 to a new imbalance of 6.279595595932788E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007901059201196417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012774483545493983); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007901059201196417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:14,537 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv654158325:80 , srv1762916065:82 , srv1976748625:82 , srv208235169:82 , srv215062711:82 , srv1575840172:83 , srv1783858506:83 , srv1790449334:83 , srv1924093900:83 , srv650881141:83 , srv780115192:83 , srv1081477302:84 , srv1118137515:84 , srv1138274407:84 , srv1209783667:84 , srv1285999293:84 , srv1312006267:84 , srv1406061524:84 , srv1607726941:84 , srv1807501835:84 , srv1960288822:84 , srv242194565:84 , srv258191024:84 , srv367698186:84 , srv43929050:84 , srv510123871:84 , srv574330285:84 , srv810761052:84 , srv951341080:84 , srv954717009:84 , srv962048164:84 , srv1038729615:85 , srv106433242:85 , srv1134342389:85 , srv127083316:85 , srv1293199351:85 , srv1373339837:85 , srv1479195164:85 , srv1542866730:85 , srv1656611270:85 , srv173507742:85 , srv1767961624:85 , srv1830604051:85 , srv1855837037:85 , srv194574828:85 , srv2119290390:85 , srv440215616:85 , srv576911209:85 , srv602689276:85 , srv671181455:85 , srv684052102:85 , srv703076053:85 , srv860606664:85 , srv875075272:85 , srv897350431:85 , srv951638659:85 , srv10112193:86 , srv1114189153:86 , srv1207977208:86 , srv1232703203:86 , srv1237948870:86 , srv1371328091:86 , srv1400363179:86 , srv1457758451:86 , srv1502859962:86 , srv1516027138:86 , srv1516952500:86 , srv1656717256:86 , srv1717173482:86 , srv1894520766:86 , srv200719763:86 , srv2012648849:86 , srv509987112:86 , srv520909766:86 , srv655055890:86 , srv729293915:86 , srv780771459:86 , srv884294288:86 , srv904278588:86 , srv979102513:86 , srv1160448194:87 , srv1271933825:87 , srv1609109008:87 , srv1624875017:87 , srv1691324474:87 , srv171199165:87 , srv2066900666:87 , srv2110818955:87 , srv346082902:87 , srv461540211:87 , srv483917511:87 , srv494409003:87 , srv790352137:87 , srv875705356:87 , srv893100102:87 , srv936904867:87 , srv1708498740:88 , srv729862846:88 , srv737971578:89 , srv1589559279:568 }
2023-09-04 21:53:14,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924093900=48, srv1160448194=8, srv520909766=70, srv2119290390=57, srv461540211=65, srv1081477302=3, srv729293915=80, srv936904867=94, srv494409003=67, srv671181455=77, srv703076053=79, srv576911209=72, srv1373339837=19, srv509987112=68, srv1609109008=31, srv655055890=76, srv10112193=0, srv242194565=59, srv346082902=61, srv1400363179=20, srv127083316=13, srv1717173482=38, srv1209783667=10, srv954717009=97, srv737971578=82, srv1691324474=35, srv1232703203=11, srv962048164=98, srv1767961624=41, srv1807501835=44, srv1406061524=21, srv1502859962=24, srv2110818955=56, srv1271933825=14, srv1855837037=46, srv1589559279=29, srv1038729615=1, srv1118137515=5, srv650881141=74, srv1656717256=34, srv780771459=84, srv951638659=96, srv602689276=73, srv173507742=39, srv1237948870=12, srv1976748625=51, srv367698186=62, srv194574828=49, srv979102513=99, srv43929050=63, srv1575840172=28, srv1138274407=7, srv729862846=81, srv1783858506=42, srv1762916065=40, srv1207977208=9, srv904278588=93, srv1516027138=25, srv1790449334=43, srv2066900666=54, srv875705356=89, srv951341080=95, srv1285999293=15, srv1708498740=36, srv171199165=37, srv860606664=87, srv897350431=92, srv1830604051=45, srv574330285=71, srv1114189153=4, srv2012648849=53, srv875075272=88, srv440215616=64, srv790352137=85, srv200719763=52, srv1457758451=22, srv1607726941=30, srv106433242=2, srv1371328091=18, srv1894520766=47, srv1960288822=50, srv1542866730=27, srv1656611270=33, srv893100102=91, srv1624875017=32, srv1516952500=26, srv654158325=75, srv780115192=83, srv208235169=55, srv258191024=60, srv884294288=90, srv1479195164=23, srv215062711=58, srv510123871=69, srv1293199351=16, srv483917511=66, srv1312006267=17, srv810761052=86, srv1134342389=6, srv684052102=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:14,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 21:53:14,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 21:53:14,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 21:53:14,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 21:53:14,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 21:53:14,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 21:53:14,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007901059201196417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012774483545493983); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007901059201196417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:14,666 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 21:53:14,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.207193368448951E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007901059201196417); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012774483545493983); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007901059201196417); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 21:53:15,096 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 263 regions; Going from a computed imbalance of 6.207193368448951E-4 to a new imbalance of 1.9616121721332856E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.029222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:15,097 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1373339837:82 , srv1609109008:83 , srv346082902:83 , srv494409003:83 , srv893100102:83 , srv10112193:84 , srv1038729615:84 , srv1081477302:84 , srv1118137515:84 , srv1160448194:84 , srv1207977208:84 , srv1237948870:84 , srv1400363179:84 , srv1457758451:84 , srv1479195164:84 , srv1502859962:84 , srv1607726941:84 , srv1656611270:84 , srv1656717256:84 , srv1708498740:84 , srv171199165:84 , srv1717173482:84 , srv1855837037:84 , srv2066900666:84 , srv461540211:84 , srv483917511:84 , srv520909766:84 , srv574330285:84 , srv602689276:84 , srv671181455:84 , srv684052102:84 , srv703076053:84 , srv729862846:84 , srv737971578:84 , srv904278588:84 , srv951341080:84 , srv954717009:84 , srv979102513:84 , srv106433242:85 , srv1114189153:85 , srv1138274407:85 , srv1209783667:85 , srv1232703203:85 , srv127083316:85 , srv1271933825:85 , srv1285999293:85 , srv1312006267:85 , srv1406061524:85 , srv1516027138:85 , srv1516952500:85 , srv1542866730:85 , srv1624875017:85 , srv1691324474:85 , srv173507742:85 , srv1762916065:85 , srv1767961624:85 , srv1783858506:85 , srv1790449334:85 , srv1830604051:85 , srv1894520766:85 , srv194574828:85 , srv2012648849:85 , srv208235169:85 , srv2110818955:85 , srv2119290390:85 , srv242194565:85 , srv367698186:85 , srv43929050:85 , srv440215616:85 , srv509987112:85 , srv510123871:85 , srv650881141:85 , srv655055890:85 , srv780115192:85 , srv780771459:85 , srv790352137:85 , srv810761052:85 , srv860606664:85 , srv875075272:85 , srv875705356:85 , srv897350431:85 , srv936904867:85 , srv951638659:85 , srv962048164:85 , srv1134342389:86 , srv1293199351:86 , srv1371328091:86 , srv1575840172:86 , srv1807501835:86 , srv1924093900:86 , srv1960288822:86 , srv1976748625:86 , srv200719763:86 , srv215062711:86 , srv258191024:86 , srv576911209:86 , srv654158325:86 , srv729293915:86 , srv884294288:86 , srv1589559279:614 }
2023-09-04 21:53:15,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:15,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924093900=48, srv1160448194=8, srv520909766=70, srv2119290390=57, srv461540211=65, srv1081477302=3, srv729293915=80, srv936904867=94, srv494409003=67, srv671181455=77, srv703076053=79, srv576911209=72, srv1373339837=19, srv509987112=68, srv1609109008=31, srv655055890=76, srv10112193=0, srv242194565=59, srv346082902=61, srv1400363179=20, srv127083316=13, srv1717173482=38, srv1209783667=10, srv954717009=97, srv737971578=82, srv1691324474=35, srv1232703203=11, srv962048164=98, srv1767961624=41, srv1807501835=44, srv1406061524=21, srv1502859962=24, srv2110818955=56, srv1271933825=14, srv1855837037=46, srv1589559279=29, srv1038729615=1, srv1118137515=5, srv650881141=74, srv1656717256=34, srv780771459=84, srv951638659=96, srv602689276=73, srv173507742=39, srv1237948870=12, srv1976748625=51, srv367698186=62, srv194574828=49, srv979102513=99, srv43929050=63, srv1575840172=28, srv1138274407=7, srv729862846=81, srv1783858506=42, srv1762916065=40, srv1207977208=9, srv904278588=93, srv1516027138=25, srv1790449334=43, srv2066900666=54, srv875705356=89, srv951341080=95, srv1285999293=15, srv1708498740=36, srv171199165=37, srv860606664=87, srv897350431=92, srv1830604051=45, srv574330285=71, srv1114189153=4, srv2012648849=53, srv875075272=88, srv440215616=64, srv790352137=85, srv200719763=52, srv1457758451=22, srv1607726941=30, srv106433242=2, srv1371328091=18, srv1894520766=47, srv1960288822=50, srv1542866730=27, srv1656611270=33, srv893100102=91, srv1624875017=32, srv1516952500=26, srv654158325=75, srv780115192=83, srv208235169=55, srv258191024=60, srv884294288=90, srv1479195164=23, srv215062711=58, srv510123871=69, srv1293199351=16, srv483917511=66, srv1312006267=17, srv810761052=86, srv1134342389=6, srv684052102=78} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 21:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 21:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 21:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 21:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 21:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 21:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 21:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 21:53:15,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 21:53:15,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 21:53:15,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 21:53:15,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 21:53:15,302 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.777455636076716E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:15,303 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1373339837:82 , srv1609109008:83 , srv346082902:83 , srv494409003:83 , srv893100102:83 , srv10112193:84 , srv1038729615:84 , srv1081477302:84 , srv1118137515:84 , srv1160448194:84 , srv1207977208:84 , srv1237948870:84 , srv1400363179:84 , srv1457758451:84 , srv1479195164:84 , srv1502859962:84 , srv1607726941:84 , srv1656611270:84 , srv1656717256:84 , srv1708498740:84 , srv171199165:84 , srv1717173482:84 , srv1855837037:84 , srv2066900666:84 , srv461540211:84 , srv483917511:84 , srv520909766:84 , srv574330285:84 , srv602689276:84 , srv671181455:84 , srv684052102:84 , srv703076053:84 , srv729862846:84 , srv737971578:84 , srv904278588:84 , srv951341080:84 , srv954717009:84 , srv979102513:84 , srv106433242:85 , srv1114189153:85 , srv1138274407:85 , srv1209783667:85 , srv1232703203:85 , srv127083316:85 , srv1271933825:85 , srv1285999293:85 , srv1312006267:85 , srv1406061524:85 , srv1516027138:85 , srv1516952500:85 , srv1542866730:85 , srv1624875017:85 , srv1691324474:85 , srv173507742:85 , srv1762916065:85 , srv1767961624:85 , srv1783858506:85 , srv1790449334:85 , srv1830604051:85 , srv1894520766:85 , srv194574828:85 , srv2012648849:85 , srv208235169:85 , srv2110818955:85 , srv2119290390:85 , srv242194565:85 , srv367698186:85 , srv43929050:85 , srv440215616:85 , srv509987112:85 , srv510123871:85 , srv650881141:85 , srv655055890:85 , srv780115192:85 , srv780771459:85 , srv790352137:85 , srv810761052:85 , srv860606664:85 , srv875075272:85 , srv875705356:85 , srv897350431:85 , srv936904867:85 , srv951638659:85 , srv962048164:85 , srv1134342389:86 , srv1293199351:86 , srv1371328091:86 , srv1575840172:86 , srv1807501835:86 , srv1924093900:86 , srv1960288822:86 , srv1976748625:86 , srv200719763:86 , srv215062711:86 , srv258191024:86 , srv576911209:86 , srv654158325:86 , srv729293915:86 , srv884294288:86 , srv1589559279:614 }
2023-09-04 21:53:15,341 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 302), ProcessCount=169 (was 169), AvailableMemoryMB=9306 (was 10133)
2023-09-04 21:53:15,350 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=169, AvailableMemoryMB=9306
2023-09-04 21:53:15,351 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 21:53:15,351 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-04 21:53:15,364 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033169011:84 , srv1073655522:84 , srv1103023483:84 , srv1138871107:84 , srv1178130171:84 , srv1207719296:84 , srv13084442:84 , srv1434925770:84 , srv1487647422:84 , srv1499754699:84 , srv1640355728:84 , srv1708689132:84 , srv1712097589:84 , srv1773949036:84 , srv1779320473:84 , srv1792954584:84 , srv1840768467:84 , srv1867273685:84 , srv1940598316:84 , srv1941651880:84 , srv1951064832:84 , srv261922089:84 , srv296433334:84 , srv442830211:84 , srv447802591:84 , srv809201311:84 , srv836549842:84 , srv904474947:84 , srv974107461:84 , srv1961671502:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-04 21:53:15,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:53:15,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1961671502=21, srv1840768467=16, srv1792954584=15, srv1207719296=5, srv296433334=23, srv974107461=29, srv836549842=27, srv1773949036=13, srv1708689132=11, srv1138871107=3, srv1867273685=17, srv13084442=6, srv447802591=25, srv1779320473=14, srv1103023483=2, srv1941651880=19, srv1434925770=7, srv1940598316=18, srv1487647422=8, srv1499754699=9, srv1033169011=0, srv904474947=28, srv261922089=22, srv809201311=26, srv1640355728=10, srv1951064832=20, srv442830211=24, srv1073655522=1, srv1712097589=12, srv1178130171=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:53:15,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:53:15,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:53:15,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:53:15,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-04 21:53:15,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.151451277416126, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:53:15,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912670261294079, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.151451277416126, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-04 21:55:15,387 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6190988 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912670261294079 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:55:15,396 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1033169011:90 , srv1073655522:90 , srv1103023483:90 , srv1138871107:90 , srv1178130171:90 , srv1207719296:90 , srv13084442:90 , srv1434925770:90 , srv1487647422:90 , srv1499754699:90 , srv1640355728:90 , srv1708689132:90 , srv1712097589:90 , srv1773949036:90 , srv1779320473:90 , srv1792954584:90 , srv1840768467:90 , srv1867273685:90 , srv1940598316:90 , srv1941651880:90 , srv1951064832:90 , srv1961671502:90 , srv261922089:90 , srv296433334:90 , srv442830211:90 , srv447802591:90 , srv809201311:90 , srv836549842:90 , srv904474947:90 , srv974107461:90 }
2023-09-04 21:55:15,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 21:55:15,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1961671502=21, srv1840768467=16, srv1792954584=15, srv1207719296=5, srv296433334=23, srv974107461=29, srv836549842=27, srv1773949036=13, srv1708689132=11, srv1138871107=3, srv1867273685=17, srv13084442=6, srv447802591=25, srv1779320473=14, srv1103023483=2, srv1941651880=19, srv1434925770=7, srv1940598316=18, srv1487647422=8, srv1499754699=9, srv1033169011=0, srv904474947=28, srv261922089=22, srv809201311=26, srv1640355728=10, srv1951064832=20, srv442830211=24, srv1073655522=1, srv1712097589=12, srv1178130171=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 21:55:15,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 21:55:15,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 21:55:15,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 21:55:15,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-04 21:55:15,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 21:55:15,423 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1033169011:90 , srv1073655522:90 , srv1103023483:90 , srv1138871107:90 , srv1178130171:90 , srv1207719296:90 , srv13084442:90 , srv1434925770:90 , srv1487647422:90 , srv1499754699:90 , srv1640355728:90 , srv1708689132:90 , srv1712097589:90 , srv1773949036:90 , srv1779320473:90 , srv1792954584:90 , srv1840768467:90 , srv1867273685:90 , srv1940598316:90 , srv1941651880:90 , srv1951064832:90 , srv1961671502:90 , srv261922089:90 , srv296433334:90 , srv442830211:90 , srv447802591:90 , srv809201311:90 , srv836549842:90 , srv904474947:90 , srv974107461:90 }
2023-09-04 21:55:15,439 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 302), ProcessCount=167 (was 169), AvailableMemoryMB=8515 (was 9306)