2023-05-14 07:53:22,609 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-14 07:53:22,924 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-14 07:53:23,038 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-14 07:53:23,099 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 07:53:23,106 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-14 07:53:23,121 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=171, AvailableMemoryMB=15006
2023-05-14 07:53:23,123 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 07:53:23,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-14 07:53:23,256 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100210112:84 , srv101832602:84 , srv1061239221:84 , srv1079203898:84 , srv1081678035:84 , srv1112070939:84 , srv1152222628:84 , srv1179955425:84 , srv1193006673:84 , srv1194875611:84 , srv122155226:84 , srv1236745367:84 , srv1241605475:84 , srv1283706984:84 , srv1295584481:84 , srv1297710097:84 , srv1302776965:84 , srv1308725200:84 , srv1309856950:84 , srv1370378304:84 , srv1404073192:84 , srv1409588554:84 , srv143229062:84 , srv1478812760:84 , srv1493892625:84 , srv1553747799:84 , srv1557308115:84 , srv1583586233:84 , srv1591771057:84 , srv160103163:84 , srv1612922863:84 , srv1614393720:84 , srv1616049394:84 , srv1639029443:84 , srv1643615190:84 , srv1667807683:84 , srv1685900552:84 , srv1689523333:84 , srv1726123299:84 , srv1822249630:84 , srv1853073131:84 , srv1866184545:84 , srv1866506250:84 , srv1877010711:84 , srv1907093973:84 , srv193681086:84 , srv1951165521:84 , srv1960857053:84 , srv1962900064:84 , srv1965291350:84 , srv1982391890:84 , srv2015181330:84 , srv2030171857:84 , srv2037974286:84 , srv2053026630:84 , srv2097110616:84 , srv260653998:84 , srv263136751:84 , srv285822195:84 , srv315018635:84 , srv341605527:84 , srv34760932:84 , srv378741023:84 , srv391117626:84 , srv401456549:84 , srv412314015:84 , srv427623299:84 , srv430051656:84 , srv451022650:84 , srv485507493:84 , srv497091670:84 , srv534674551:84 , srv538352707:84 , srv556464216:84 , srv568848079:84 , srv586353479:84 , srv59382897:84 , srv59916733:84 , srv600845467:84 , srv652806321:84 , srv657859995:84 , srv657993861:84 , srv663391676:84 , srv67558100:84 , srv681019474:84 , srv746066205:84 , srv769400755:84 , srv810383241:84 , srv817955126:84 , srv867236161:84 , srv86866090:84 , srv876418019:84 , srv883260194:84 , srv896646212:84 , srv92536345:84 , srv929172137:84 , srv943850737:84 , srv991955992:84 , srv99245482:84 , srv2043854756:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-14 07:53:23,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:23,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:23,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:23,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:23,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:23,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:23,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:23,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:23,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:23,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:23,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:23,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:23,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:23,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:23,588 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 07:53:23,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 07:53:23,959 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 575 ms to try 5000 different iterations.  Found a solution that moves 4721 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17504397025143828. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06177690574197408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5245555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825310004822698, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23716666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:23,980 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv681019474:82 , srv1236745367:83 , srv193681086:83 , srv2030171857:83 , srv427623299:83 , srv534674551:83 , srv59382897:83 , srv652806321:83 , srv1112070939:84 , srv1241605475:84 , srv1370378304:84 , srv143229062:84 , srv1960857053:84 , srv2015181330:84 , srv341605527:84 , srv391117626:84 , srv497091670:84 , srv1079203898:85 , srv1152222628:85 , srv1193006673:85 , srv1302776965:85 , srv1409588554:85 , srv1591771057:85 , srv1614393720:85 , srv1643615190:85 , srv1951165521:85 , srv401456549:85 , srv430051656:85 , srv451022650:85 , srv568848079:85 , srv657859995:85 , srv657993861:85 , srv67558100:85 , srv769400755:85 , srv810383241:85 , srv817955126:85 , srv876418019:85 , srv991955992:85 , srv1081678035:86 , srv1283706984:86 , srv1297710097:86 , srv1308725200:86 , srv1309856950:86 , srv1404073192:86 , srv1553747799:86 , srv1612922863:86 , srv1616049394:86 , srv1877010711:86 , srv1907093973:86 , srv1965291350:86 , srv2037974286:86 , srv2097110616:86 , srv260653998:86 , srv315018635:86 , srv34760932:86 , srv663391676:86 , srv896646212:86 , srv929172137:86 , srv1194875611:87 , srv1478812760:87 , srv1557308115:87 , srv1822249630:87 , srv1982391890:87 , srv285822195:87 , srv378741023:87 , srv586353479:87 , srv600845467:87 , srv943850737:87 , srv101832602:88 , srv1061239221:88 , srv1493892625:88 , srv1726123299:88 , srv1866184545:88 , srv2053026630:88 , srv485507493:88 , srv538352707:88 , srv867236161:88 , srv86866090:88 , srv92536345:88 , srv122155226:89 , srv1583586233:89 , srv263136751:89 , srv556464216:89 , srv59916733:89 , srv883260194:89 , srv99245482:89 , srv1295584481:90 , srv1853073131:90 , srv412314015:90 , srv1179955425:91 , srv160103163:91 , srv1667807683:91 , srv1685900552:91 , srv1962900064:91 , srv100210112:92 , srv1639029443:92 , srv1689523333:92 , srv1866506250:92 , srv746066205:92 , srv2043854756:430 }
2023-05-14 07:53:23,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:23,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:24,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:24,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:24,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:24,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:24,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:24,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:24,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:24,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:24,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:24,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:24,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:24,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:24,191 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06177690574197408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825310004822698, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23716666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:24,191 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 07:53:24,192 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17501091310289366, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03825310004822698, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06177690574197408, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03825310004822698, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17016666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23716666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 07:53:24,551 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 509 ms to try 5000 different iterations.  Found a solution that moves 2587 regions; Going from a computed imbalance of 0.17501091310289366 to a new imbalance of 0.015432732111242256. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020281717096564712); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03605084325869923, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28744444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020281717096564712); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:24,572 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1853073131:79 , srv1866506250:79 , srv1667807683:80 , srv1689523333:80 , srv1962900064:80 , srv1179955425:81 , srv160103163:81 , srv1639029443:81 , srv100210112:82 , srv1295584481:82 , srv1493892625:82 , srv263136751:82 , srv412314015:82 , srv485507493:82 , srv59916733:82 , srv746066205:82 , srv99245482:82 , srv1061239221:83 , srv1583586233:83 , srv1685900552:83 , srv1822249630:83 , srv86866090:83 , srv1308725200:84 , srv1557308115:84 , srv1616049394:84 , srv1877010711:84 , srv1965291350:84 , srv1982391890:84 , srv285822195:84 , srv867236161:84 , srv883260194:84 , srv896646212:84 , srv929172137:84 , srv101832602:85 , srv1081678035:85 , srv1309856950:85 , srv1478812760:85 , srv34760932:85 , srv378741023:85 , srv556464216:85 , srv568848079:85 , srv586353479:85 , srv663391676:85 , srv67558100:85 , srv817955126:85 , srv1079203898:86 , srv1193006673:86 , srv1194875611:86 , srv122155226:86 , srv1370378304:86 , srv1404073192:86 , srv1553747799:86 , srv1612922863:86 , srv1907093973:86 , srv2015181330:86 , srv2037974286:86 , srv2053026630:86 , srv315018635:86 , srv600845467:86 , srv92536345:86 , srv1283706984:87 , srv1302776965:87 , srv1643615190:87 , srv1726123299:87 , srv1866184545:87 , srv1960857053:87 , srv260653998:87 , srv341605527:87 , srv391117626:87 , srv401456549:87 , srv427623299:87 , srv657993861:87 , srv769400755:87 , srv943850737:87 , srv1112070939:88 , srv1241605475:88 , srv1297710097:88 , srv1951165521:88 , srv538352707:88 , srv652806321:88 , srv657859995:88 , srv810383241:88 , srv991955992:88 , srv1152222628:89 , srv1236745367:89 , srv1409588554:89 , srv1591771057:89 , srv193681086:89 , srv2030171857:89 , srv2097110616:89 , srv430051656:89 , srv143229062:90 , srv1614393720:90 , srv59382897:90 , srv876418019:90 , srv451022650:91 , srv497091670:91 , srv534674551:92 , srv681019474:92 , srv2043854756:524 }
2023-05-14 07:53:24,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:24,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:24,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:24,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:24,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:24,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:24,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:24,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:24,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:24,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:24,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:24,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:24,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020281717096564712); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03605084325869923, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020281717096564712); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:24,791 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 07:53:24,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015414617550071976, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020281717096564712); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03605084325869923, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020281717096564712); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012583333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 07:53:25,111 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 450 ms to try 5000 different iterations.  Found a solution that moves 978 regions; Going from a computed imbalance of 0.015414617550071976 to a new imbalance of 7.826568458991213E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.10866666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:25,113 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv122155226:82 , srv451022650:82 , srv538352707:82 , srv876418019:82 , srv1152222628:83 , srv143229062:83 , srv1591771057:83 , srv1614393720:83 , srv1685900552:83 , srv1726123299:83 , srv1866184545:83 , srv430051656:83 , srv497091670:83 , srv534674551:83 , srv556464216:83 , srv746066205:83 , srv100210112:84 , srv1194875611:84 , srv1283706984:84 , srv1297710097:84 , srv1409588554:84 , srv1478812760:84 , srv1951165521:84 , srv2097110616:84 , srv260653998:84 , srv59382897:84 , srv600845467:84 , srv657859995:84 , srv681019474:84 , srv92536345:84 , srv943850737:84 , srv101832602:85 , srv1236745367:85 , srv1241605475:85 , srv1302776965:85 , srv1553747799:85 , srv1583586233:85 , srv160103163:85 , srv1612922863:85 , srv1639029443:85 , srv1689523333:85 , srv1907093973:85 , srv193681086:85 , srv2030171857:85 , srv2037974286:85 , srv2053026630:85 , srv315018635:85 , srv34760932:85 , srv401456549:85 , srv412314015:85 , srv657993861:85 , srv810383241:85 , srv883260194:85 , srv991955992:85 , srv1061239221:86 , srv1079203898:86 , srv1081678035:86 , srv1112070939:86 , srv1295584481:86 , srv1309856950:86 , srv1404073192:86 , srv1557308115:86 , srv1643615190:86 , srv1667807683:86 , srv1877010711:86 , srv1960857053:86 , srv1982391890:86 , srv263136751:86 , srv341605527:86 , srv378741023:86 , srv586353479:86 , srv59916733:86 , srv652806321:86 , srv769400755:86 , srv867236161:86 , srv1179955425:87 , srv1193006673:87 , srv1370378304:87 , srv1822249630:87 , srv1866506250:87 , srv1962900064:87 , srv1965291350:87 , srv2015181330:87 , srv391117626:87 , srv485507493:87 , srv663391676:87 , srv67558100:87 , srv817955126:87 , srv86866090:87 , srv896646212:87 , srv929172137:87 , srv99245482:87 , srv1308725200:88 , srv1493892625:88 , srv1616049394:88 , srv1853073131:88 , srv285822195:88 , srv427623299:88 , srv568848079:88 , srv2043854756:560 }
2023-05-14 07:53:25,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:25,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:25,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:25,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:25,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:25,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:25,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:25,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:25,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:25,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:25,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:25,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:25,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:25,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:25,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:25,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:25,297 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 07:53:25,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.758087435316944E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006322977731057954); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010583429438308044); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006322977731057954); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 07:53:25,716 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 557 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 7.758087435316944E-4 to a new imbalance of 4.685752392381446E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0028029165506084056); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:25,717 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1179955425:83 , srv1295584481:83 , srv1866506250:83 , srv2097110616:83 , srv285822195:83 , srv100210112:84 , srv101832602:84 , srv1061239221:84 , srv1112070939:84 , srv1193006673:84 , srv122155226:84 , srv1297710097:84 , srv1308725200:84 , srv1309856950:84 , srv1370378304:84 , srv1404073192:84 , srv1409588554:84 , srv1614393720:84 , srv1616049394:84 , srv1639029443:84 , srv1643615190:84 , srv1726123299:84 , srv1866184545:84 , srv1962900064:84 , srv2015181330:84 , srv2053026630:84 , srv263136751:84 , srv341605527:84 , srv378741023:84 , srv427623299:84 , srv451022650:84 , srv497091670:84 , srv534674551:84 , srv538352707:84 , srv568848079:84 , srv586353479:84 , srv657993861:84 , srv663391676:84 , srv681019474:84 , srv769400755:84 , srv810383241:84 , srv86866090:84 , srv883260194:84 , srv92536345:84 , srv991955992:84 , srv99245482:84 , srv1079203898:85 , srv1081678035:85 , srv1152222628:85 , srv1194875611:85 , srv1236745367:85 , srv1241605475:85 , srv1283706984:85 , srv1302776965:85 , srv143229062:85 , srv1478812760:85 , srv1493892625:85 , srv1553747799:85 , srv1557308115:85 , srv1583586233:85 , srv1591771057:85 , srv160103163:85 , srv1612922863:85 , srv1667807683:85 , srv1685900552:85 , srv1822249630:85 , srv1853073131:85 , srv193681086:85 , srv1951165521:85 , srv1960857053:85 , srv1965291350:85 , srv1982391890:85 , srv2037974286:85 , srv315018635:85 , srv391117626:85 , srv401456549:85 , srv412314015:85 , srv430051656:85 , srv485507493:85 , srv556464216:85 , srv59916733:85 , srv600845467:85 , srv652806321:85 , srv657859995:85 , srv67558100:85 , srv817955126:85 , srv867236161:85 , srv876418019:85 , srv896646212:85 , srv929172137:85 , srv943850737:85 , srv1689523333:86 , srv1877010711:86 , srv1907093973:86 , srv2030171857:86 , srv260653998:86 , srv34760932:86 , srv59382897:86 , srv746066205:86 , srv2043854756:628 }
2023-05-14 07:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:25,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:25,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:25,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:25,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:25,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:25,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:25,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:25,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:25,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:25,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:25,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:25,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0028029165506084056); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:25,869 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-14 07:53:25,869 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.5148999406787724E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0028029165506084056); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-14 07:53:26,199 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 447 ms to try 5000 different iterations.  Found a solution that moves 44 regions; Going from a computed imbalance of 4.5148999406787724E-5 to a new imbalance of 8.838742148063874E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.004888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:26,200 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1493892625:83 , srv1689523333:83 , srv1907093973:83 , srv2030171857:83 , srv2053026630:83 , srv260653998:83 , srv391117626:83 , srv59382897:83 , srv746066205:83 , srv867236161:83 , srv943850737:83 , srv100210112:84 , srv101832602:84 , srv1079203898:84 , srv1081678035:84 , srv1112070939:84 , srv1152222628:84 , srv1179955425:84 , srv1193006673:84 , srv1194875611:84 , srv1236745367:84 , srv1241605475:84 , srv1283706984:84 , srv1297710097:84 , srv1302776965:84 , srv1308725200:84 , srv1404073192:84 , srv1409588554:84 , srv143229062:84 , srv1553747799:84 , srv1557308115:84 , srv1583586233:84 , srv1591771057:84 , srv160103163:84 , srv1612922863:84 , srv1614393720:84 , srv1616049394:84 , srv1639029443:84 , srv1643615190:84 , srv1667807683:84 , srv1685900552:84 , srv1726123299:84 , srv1822249630:84 , srv1853073131:84 , srv1866184545:84 , srv1877010711:84 , srv193681086:84 , srv1951165521:84 , srv1960857053:84 , srv1962900064:84 , srv1965291350:84 , srv1982391890:84 , srv2037974286:84 , srv2097110616:84 , srv285822195:84 , srv315018635:84 , srv34760932:84 , srv378741023:84 , srv401456549:84 , srv412314015:84 , srv427623299:84 , srv430051656:84 , srv451022650:84 , srv485507493:84 , srv497091670:84 , srv534674551:84 , srv538352707:84 , srv556464216:84 , srv568848079:84 , srv586353479:84 , srv59916733:84 , srv600845467:84 , srv652806321:84 , srv657859995:84 , srv663391676:84 , srv67558100:84 , srv681019474:84 , srv769400755:84 , srv810383241:84 , srv817955126:84 , srv86866090:84 , srv876418019:84 , srv883260194:84 , srv896646212:84 , srv92536345:84 , srv929172137:84 , srv991955992:84 , srv99245482:84 , srv1061239221:85 , srv122155226:85 , srv1295584481:85 , srv1309856950:85 , srv1370378304:85 , srv1478812760:85 , srv1866506250:85 , srv2015181330:85 , srv263136751:85 , srv341605527:85 , srv657993861:85 , srv2043854756:684 }
2023-05-14 07:53:26,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:26,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv556464216=74, srv883260194=93, srv391117626=64, srv1583586233=27, srv1616049394=32, srv2030171857=52, srv1194875611=9, srv160103163=29, srv497091670=71, srv2015181330=51, srv1726123299=38, srv1295584481=14, srv2043854756=54, srv991955992=98, srv876418019=92, srv122155226=10, srv412314015=66, srv260653998=57, srv67558100=84, srv1866506250=42, srv193681086=45, srv568848079=75, srv315018635=60, srv1553747799=25, srv867236161=90, srv1302776965=16, srv1557308115=26, srv1308725200=17, srv1614393720=31, srv101832602=1, srv1667807683=35, srv451022650=69, srv1409588554=21, srv2097110616=56, srv534674551=72, srv1962900064=48, srv1685900552=36, srv896646212=94, srv652806321=80, srv657859995=81, srv769400755=87, srv600845467=79, srv943850737=97, srv1951165521=46, srv59382897=77, srv59916733=78, srv2053026630=55, srv1965291350=49, srv1179955425=7, srv92536345=95, srv1404073192=20, srv586353479=76, srv929172137=96, srv401456549=65, srv817955126=89, srv430051656=68, srv746066205=86, srv1982391890=50, srv378741023=63, srv34760932=62, srv99245482=99, srv1309856950=18, srv1591771057=28, srv1960857053=47, srv341605527=61, srv86866090=91, srv100210112=0, srv485507493=70, srv1152222628=6, srv2037974286=53, srv1061239221=2, srv1193006673=8, srv1236745367=11, srv1822249630=39, srv1079203898=3, srv657993861=82, srv1866184545=41, srv427623299=67, srv663391676=83, srv143229062=22, srv1112070939=5, srv1370378304=19, srv1853073131=40, srv1612922863=30, srv1689523333=37, srv1877010711=43, srv1478812760=23, srv1639029443=33, srv285822195=59, srv538352707=73, srv1493892625=24, srv1643615190=34, srv1297710097=15, srv681019474=85, srv263136751=58, srv1283706984=13, srv1907093973=44, srv810383241=88, srv1241605475=12, srv1081678035=4} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:26,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:26,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:26,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-14 07:53:26,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-14 07:53:26,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-14 07:53:26,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-14 07:53:26,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-14 07:53:26,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-14 07:53:26,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-14 07:53:26,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-14 07:53:26,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-14 07:53:26,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-14 07:53:26,378 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:26,379 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1493892625:83 , srv1689523333:83 , srv1907093973:83 , srv2030171857:83 , srv2053026630:83 , srv260653998:83 , srv391117626:83 , srv59382897:83 , srv746066205:83 , srv867236161:83 , srv943850737:83 , srv100210112:84 , srv101832602:84 , srv1079203898:84 , srv1081678035:84 , srv1112070939:84 , srv1152222628:84 , srv1179955425:84 , srv1193006673:84 , srv1194875611:84 , srv1236745367:84 , srv1241605475:84 , srv1283706984:84 , srv1297710097:84 , srv1302776965:84 , srv1308725200:84 , srv1404073192:84 , srv1409588554:84 , srv143229062:84 , srv1553747799:84 , srv1557308115:84 , srv1583586233:84 , srv1591771057:84 , srv160103163:84 , srv1612922863:84 , srv1614393720:84 , srv1616049394:84 , srv1639029443:84 , srv1643615190:84 , srv1667807683:84 , srv1685900552:84 , srv1726123299:84 , srv1822249630:84 , srv1853073131:84 , srv1866184545:84 , srv1877010711:84 , srv193681086:84 , srv1951165521:84 , srv1960857053:84 , srv1962900064:84 , srv1965291350:84 , srv1982391890:84 , srv2037974286:84 , srv2097110616:84 , srv285822195:84 , srv315018635:84 , srv34760932:84 , srv378741023:84 , srv401456549:84 , srv412314015:84 , srv427623299:84 , srv430051656:84 , srv451022650:84 , srv485507493:84 , srv497091670:84 , srv534674551:84 , srv538352707:84 , srv556464216:84 , srv568848079:84 , srv586353479:84 , srv59916733:84 , srv600845467:84 , srv652806321:84 , srv657859995:84 , srv663391676:84 , srv67558100:84 , srv681019474:84 , srv769400755:84 , srv810383241:84 , srv817955126:84 , srv86866090:84 , srv876418019:84 , srv883260194:84 , srv896646212:84 , srv92536345:84 , srv929172137:84 , srv991955992:84 , srv99245482:84 , srv1061239221:85 , srv122155226:85 , srv1295584481:85 , srv1309856950:85 , srv1370378304:85 , srv1478812760:85 , srv1866506250:85 , srv2015181330:85 , srv263136751:85 , srv341605527:85 , srv657993861:85 , srv2043854756:684 }
2023-05-14 07:53:26,413 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 311) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=14142 (was 15006)
2023-05-14 07:53:26,426 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=171, AvailableMemoryMB=14141
2023-05-14 07:53:26,427 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-14 07:53:26,427 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-14 07:53:26,440 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041323062:84 , srv1124614708:84 , srv1188322597:84 , srv1263368242:84 , srv1286036175:84 , srv1364815804:84 , srv1389566667:84 , srv1435605815:84 , srv1442833762:84 , srv1668173296:84 , srv1681140449:84 , srv1687680902:84 , srv171165181:84 , srv1774167360:84 , srv1920571953:84 , srv1943103835:84 , srv1946779120:84 , srv1973508182:84 , srv2001151448:84 , srv2002690600:84 , srv458459440:84 , srv642172218:84 , srv778027445:84 , srv795840580:84 , srv829297606:84 , srv838162830:84 , srv902196878:84 , srv985335568:84 , srv993255297:84 , srv1351452068:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-14 07:53:26,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:53:26,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1687680902=12, srv1286036175=4, srv1681140449=11, srv1364815804=6, srv1774167360=14, srv1188322597=2, srv829297606=25, srv838162830=26, srv1973508182=18, srv778027445=23, srv171165181=13, srv2002690600=20, srv1946779120=17, srv1124614708=1, srv1389566667=7, srv1943103835=16, srv1920571953=15, srv993255297=29, srv902196878=27, srv1442833762=9, srv1263368242=3, srv642172218=22, srv1351452068=5, srv795840580=24, srv985335568=28, srv1041323062=0, srv1668173296=10, srv2001151448=19, srv458459440=21, srv1435605815=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:53:26,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:53:26,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:53:26,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:53:26,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-14 07:53:26,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1818655191361693, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:53:26,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912766095576621, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1818655191361693, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-14 07:55:26,460 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6116368 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912766095576621 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:55:26,467 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1041323062:90 , srv1124614708:90 , srv1188322597:90 , srv1263368242:90 , srv1286036175:90 , srv1351452068:90 , srv1364815804:90 , srv1389566667:90 , srv1435605815:90 , srv1442833762:90 , srv1668173296:90 , srv1681140449:90 , srv1687680902:90 , srv171165181:90 , srv1774167360:90 , srv1920571953:90 , srv1943103835:90 , srv1946779120:90 , srv1973508182:90 , srv2001151448:90 , srv2002690600:90 , srv458459440:90 , srv642172218:90 , srv778027445:90 , srv795840580:90 , srv829297606:90 , srv838162830:90 , srv902196878:90 , srv985335568:90 , srv993255297:90 }
2023-05-14 07:55:26,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-14 07:55:26,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1687680902=12, srv1286036175=4, srv1681140449=11, srv1364815804=6, srv1774167360=14, srv1188322597=2, srv829297606=25, srv838162830=26, srv1973508182=18, srv778027445=23, srv171165181=13, srv2002690600=20, srv1946779120=17, srv1124614708=1, srv1389566667=7, srv1943103835=16, srv1920571953=15, srv993255297=29, srv902196878=27, srv1442833762=9, srv1263368242=3, srv642172218=22, srv1351452068=5, srv795840580=24, srv985335568=28, srv1041323062=0, srv1668173296=10, srv2001151448=19, srv458459440=21, srv1435605815=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-14 07:55:26,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-14 07:55:26,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-14 07:55:26,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-14 07:55:26,491 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1041323062:90 , srv1124614708:90 , srv1188322597:90 , srv1263368242:90 , srv1286036175:90 , srv1351452068:90 , srv1364815804:90 , srv1389566667:90 , srv1435605815:90 , srv1442833762:90 , srv1668173296:90 , srv1681140449:90 , srv1687680902:90 , srv171165181:90 , srv1774167360:90 , srv1920571953:90 , srv1943103835:90 , srv1946779120:90 , srv1973508182:90 , srv2001151448:90 , srv2002690600:90 , srv458459440:90 , srv642172218:90 , srv778027445:90 , srv795840580:90 , srv829297606:90 , srv838162830:90 , srv902196878:90 , srv985335568:90 , srv993255297:90 }
2023-05-14 07:55:26,504 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 318), ProcessCount=169 (was 171), AvailableMemoryMB=14005 (was 14141)