2023-09-25 13:53:13,670 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-25 13:53:13,993 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-25 13:53:14,113 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-25 13:53:14,174 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 13:53:14,182 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 13:53:14,199 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=170, AvailableMemoryMB=8580
2023-09-25 13:53:14,201 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 13:53:14,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 13:53:14,355 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1033071468:84 , srv1036035474:84 , srv1043223148:84 , srv1046682607:84 , srv1072259356:84 , srv1127821264:84 , srv113323279:84 , srv1146091705:84 , srv1291640007:84 , srv1321863232:84 , srv1342624397:84 , srv1345331802:84 , srv1355837102:84 , srv1425764612:84 , srv1459146105:84 , srv1486553406:84 , srv1505078924:84 , srv1506120871:84 , srv1508962643:84 , srv1514525652:84 , srv1518470506:84 , srv1526070968:84 , srv1559483756:84 , srv1580102432:84 , srv1581315053:84 , srv15877799:84 , srv1607652359:84 , srv1632053308:84 , srv1645229704:84 , srv1646612048:84 , srv1654828210:84 , srv1657972213:84 , srv1665917259:84 , srv1693682573:84 , srv1693698603:84 , srv1700747317:84 , srv1770988137:84 , srv1809580502:84 , srv1852749022:84 , srv1863558821:84 , srv1893967974:84 , srv1972925642:84 , srv1976742876:84 , srv1993088393:84 , srv2003373376:84 , srv201190659:84 , srv2029711942:84 , srv2042667135:84 , srv20725895:84 , srv2075134966:84 , srv2090787072:84 , srv2113209414:84 , srv249971425:84 , srv280607259:84 , srv289994759:84 , srv29087901:84 , srv299297657:84 , srv334260619:84 , srv345332153:84 , srv347199:84 , srv357504579:84 , srv39176239:84 , srv410166729:84 , srv436798428:84 , srv438610747:84 , srv443267446:84 , srv465237326:84 , srv491013747:84 , srv505092709:84 , srv52908386:84 , srv588346462:84 , srv588538272:84 , srv657159697:84 , srv675164970:84 , srv698080584:84 , srv715988076:84 , srv72054912:84 , srv730284121:84 , srv771421268:84 , srv781526698:84 , srv795939163:84 , srv810352264:84 , srv811598941:84 , srv812577862:84 , srv825348661:84 , srv856861896:84 , srv870740418:84 , srv874104104:84 , srv874186844:84 , srv882717653:84 , srv883835346:84 , srv887601334:84 , srv889712891:84 , srv890398451:84 , srv893023278:84 , srv897974623:84 , srv90371565:84 , srv937076720:84 , srv996034645:84 , srv1212961067:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-25 13:53:14,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:14,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:14,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:14,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:14,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:14,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:14,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:14,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:14,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:14,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:14,787 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:14,788 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 13:53:14,788 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 13:53:15,182 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 667 ms to try 5000 different iterations.  Found a solution that moves 4678 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1817043783776359. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04342230929782759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05428238093442672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5197777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04342230929782759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:15,200 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2090787072:82 , srv874186844:82 , srv890398451:82 , srv937076720:82 , srv1072259356:83 , srv113323279:83 , srv1342624397:83 , srv1506120871:83 , srv1508962643:83 , srv1514525652:83 , srv1559483756:83 , srv201190659:83 , srv2042667135:83 , srv20725895:83 , srv443267446:83 , srv715988076:83 , srv72054912:83 , srv1036035474:84 , srv1291640007:84 , srv1657972213:84 , srv1693698603:84 , srv1809580502:84 , srv465237326:84 , srv505092709:84 , srv675164970:84 , srv856861896:84 , srv889712891:84 , srv90371565:84 , srv996034645:84 , srv1043223148:85 , srv1321863232:85 , srv1459146105:85 , srv1645229704:85 , srv1700747317:85 , srv1852749022:85 , srv1976742876:85 , srv2029711942:85 , srv249971425:85 , srv280607259:85 , srv289994759:85 , srv299297657:85 , srv334260619:85 , srv39176239:85 , srv410166729:85 , srv438610747:85 , srv588538272:85 , srv811598941:85 , srv825348661:85 , srv870740418:85 , srv893023278:85 , srv1033071468:86 , srv1505078924:86 , srv1526070968:86 , srv1893967974:86 , srv1972925642:86 , srv588346462:86 , srv657159697:86 , srv795939163:86 , srv882717653:86 , srv883835346:86 , srv1046682607:87 , srv1127821264:87 , srv1355837102:87 , srv1425764612:87 , srv1580102432:87 , srv15877799:87 , srv1863558821:87 , srv2113209414:87 , srv52908386:87 , srv781526698:87 , srv1146091705:88 , srv1345331802:88 , srv1518470506:88 , srv1581315053:88 , srv1632053308:88 , srv1646612048:88 , srv1770988137:88 , srv2003373376:88 , srv2075134966:88 , srv345332153:88 , srv491013747:88 , srv771421268:88 , srv1607652359:89 , srv29087901:89 , srv436798428:89 , srv810352264:89 , srv812577862:89 , srv887601334:89 , srv1486553406:90 , srv1693682573:90 , srv698080584:90 , srv730284121:90 , srv1654828210:91 , srv347199:91 , srv357504579:91 , srv897974623:91 , srv1665917259:92 , srv1993088393:92 , srv874104104:96 , srv1212961067:476 }
2023-09-25 13:53:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:15,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:15,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:15,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:15,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:15,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:15,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:15,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:15,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:15,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:15,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04342230929782759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05428238093442672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04342230929782759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:15,433 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 13:53:15,433 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18167162232152667, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04342230929782759, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05428238093442672, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04342230929782759, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17725, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24041666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 13:53:15,800 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 535 ms to try 5000 different iterations.  Found a solution that moves 2621 regions; Going from a computed imbalance of 0.18167162232152667 to a new imbalance of 0.01423959149136296. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02453813287686999); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304929488288506, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2912222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02453813287686999); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:15,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv874104104:75 , srv1486553406:80 , srv1993088393:80 , srv357504579:80 , srv1654828210:81 , srv347199:81 , srv698080584:81 , srv812577862:81 , srv1425764612:82 , srv1518470506:82 , srv1693682573:82 , srv730284121:82 , srv887601334:82 , srv1046682607:83 , srv1581315053:83 , srv1665917259:83 , srv1893967974:83 , srv2003373376:83 , srv29087901:83 , srv345332153:83 , srv781526698:83 , srv810352264:83 , srv1127821264:84 , srv1146091705:84 , srv1345331802:84 , srv1459146105:84 , srv1505078924:84 , srv1526070968:84 , srv15877799:84 , srv1646612048:84 , srv1770988137:84 , srv1972925642:84 , srv2113209414:84 , srv436798428:84 , srv1700747317:85 , srv1809580502:85 , srv2029711942:85 , srv2075134966:85 , srv249971425:85 , srv334260619:85 , srv491013747:85 , srv52908386:85 , srv588346462:85 , srv657159697:85 , srv856861896:85 , srv889712891:85 , srv897974623:85 , srv1033071468:86 , srv1043223148:86 , srv1355837102:86 , srv1632053308:86 , srv1645229704:86 , srv1852749022:86 , srv1976742876:86 , srv280607259:86 , srv588538272:86 , srv771421268:86 , srv795939163:86 , srv825348661:86 , srv882717653:86 , srv893023278:86 , srv1072259356:87 , srv1580102432:87 , srv1693698603:87 , srv2042667135:87 , srv20725895:87 , srv289994759:87 , srv299297657:87 , srv39176239:87 , srv410166729:87 , srv505092709:87 , srv72054912:87 , srv811598941:87 , srv1036035474:88 , srv1514525652:88 , srv1559483756:88 , srv1607652359:88 , srv1863558821:88 , srv465237326:88 , srv883835346:88 , srv1506120871:89 , srv1657972213:89 , srv443267446:89 , srv874186844:89 , srv90371565:89 , srv113323279:90 , srv1291640007:90 , srv1321863232:90 , srv1508962643:90 , srv201190659:90 , srv2090787072:90 , srv438610747:90 , srv715988076:90 , srv870740418:90 , srv996034645:90 , srv1342624397:91 , srv675164970:91 , srv890398451:92 , srv937076720:92 , srv1212961067:516 }
2023-09-25 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:15,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:15,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:15,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:15,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:15,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:15,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:15,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:15,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:15,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:15,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:15,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:15,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:15,979 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02453813287686999); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304929488288506, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02453813287686999); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:15,980 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 13:53:15,980 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014221238857104244, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02453813287686999); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304929488288506, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02453813287686999); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 13:53:16,320 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 452 ms to try 5000 different iterations.  Found a solution that moves 941 regions; Going from a computed imbalance of 0.014221238857104244 to a new imbalance of 7.360772276962692E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.10455555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:16,321 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1607652359:81 , srv897974623:81 , srv1321863232:82 , srv1863558821:82 , srv675164970:82 , srv890398451:82 , srv1580102432:83 , srv1632053308:83 , srv870740418:83 , srv883835346:83 , srv937076720:83 , srv113323279:84 , srv1291640007:84 , srv1342624397:84 , srv1355837102:84 , srv1508962643:84 , srv1657972213:84 , srv1665917259:84 , srv2075134966:84 , srv436798428:84 , srv491013747:84 , srv715988076:84 , srv771421268:84 , srv90371565:84 , srv996034645:84 , srv1033071468:85 , srv1036035474:85 , srv1146091705:85 , srv1345331802:85 , srv1646612048:85 , srv1654828210:85 , srv1693682573:85 , srv1852749022:85 , srv1993088393:85 , srv201190659:85 , srv29087901:85 , srv347199:85 , srv39176239:85 , srv410166729:85 , srv438610747:85 , srv443267446:85 , srv52908386:85 , srv811598941:85 , srv882717653:85 , srv1043223148:86 , srv1506120871:86 , srv1514525652:86 , srv1526070968:86 , srv15877799:86 , srv1770988137:86 , srv1976742876:86 , srv2090787072:86 , srv2113209414:86 , srv280607259:86 , srv289994759:86 , srv299297657:86 , srv345332153:86 , srv465237326:86 , srv588346462:86 , srv588538272:86 , srv698080584:86 , srv730284121:86 , srv795939163:86 , srv810352264:86 , srv874104104:86 , srv1046682607:87 , srv1072259356:87 , srv1127821264:87 , srv1486553406:87 , srv1559483756:87 , srv1581315053:87 , srv1693698603:87 , srv1700747317:87 , srv1972925642:87 , srv2003373376:87 , srv2029711942:87 , srv334260619:87 , srv357504579:87 , srv505092709:87 , srv657159697:87 , srv72054912:87 , srv781526698:87 , srv812577862:87 , srv825348661:87 , srv856861896:87 , srv874186844:87 , srv887601334:87 , srv893023278:87 , srv1425764612:88 , srv1459146105:88 , srv1505078924:88 , srv1518470506:88 , srv1645229704:88 , srv1809580502:88 , srv2042667135:88 , srv20725895:88 , srv249971425:88 , srv1893967974:89 , srv889712891:89 , srv1212961067:527 }
2023-09-25 13:53:16,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:16,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:16,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:16,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:16,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:16,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:16,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:16,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:16,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:16,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:16,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:16,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:16,507 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:16,508 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 13:53:16,508 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.294882048662604E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006883854646552482); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008026331525381385); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006883854646552482); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 13:53:16,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 515 ms to try 5000 different iterations.  Found a solution that moves 235 regions; Going from a computed imbalance of 7.294882048662604E-4 to a new imbalance of 2.692236473793895E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.026111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:16,881 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1645229704:83 , srv438610747:83 , srv1072259356:84 , srv1127821264:84 , srv1291640007:84 , srv1345331802:84 , srv1505078924:84 , srv1506120871:84 , srv1514525652:84 , srv1518470506:84 , srv1559483756:84 , srv1581315053:84 , srv1632053308:84 , srv1665917259:84 , srv1693698603:84 , srv1770988137:84 , srv1893967974:84 , srv1993088393:84 , srv2003373376:84 , srv201190659:84 , srv2042667135:84 , srv20725895:84 , srv2090787072:84 , srv249971425:84 , srv289994759:84 , srv299297657:84 , srv465237326:84 , srv657159697:84 , srv715988076:84 , srv72054912:84 , srv730284121:84 , srv771421268:84 , srv795939163:84 , srv810352264:84 , srv825348661:84 , srv870740418:84 , srv874186844:84 , srv887601334:84 , srv889712891:84 , srv996034645:84 , srv1033071468:85 , srv1036035474:85 , srv1043223148:85 , srv1046682607:85 , srv113323279:85 , srv1146091705:85 , srv1321863232:85 , srv1342624397:85 , srv1355837102:85 , srv1425764612:85 , srv1459146105:85 , srv1486553406:85 , srv1508962643:85 , srv1580102432:85 , srv15877799:85 , srv1607652359:85 , srv1646612048:85 , srv1654828210:85 , srv1657972213:85 , srv1693682573:85 , srv1700747317:85 , srv1809580502:85 , srv1863558821:85 , srv1972925642:85 , srv1976742876:85 , srv2029711942:85 , srv2075134966:85 , srv2113209414:85 , srv280607259:85 , srv29087901:85 , srv334260619:85 , srv345332153:85 , srv347199:85 , srv357504579:85 , srv39176239:85 , srv410166729:85 , srv436798428:85 , srv443267446:85 , srv491013747:85 , srv505092709:85 , srv52908386:85 , srv588346462:85 , srv588538272:85 , srv675164970:85 , srv698080584:85 , srv781526698:85 , srv811598941:85 , srv812577862:85 , srv874104104:85 , srv882717653:85 , srv883835346:85 , srv893023278:85 , srv897974623:85 , srv90371565:85 , srv937076720:85 , srv1526070968:86 , srv1852749022:86 , srv856861896:86 , srv890398451:86 , srv1212961067:623 }
2023-09-25 13:53:16,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:16,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:16,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:16,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:16,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:16,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:16,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:17,006 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:17,006 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 13:53:17,007 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5276859567851735E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 13:53:17,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 340 ms to try 5000 different iterations.  Found a solution that moves 17 regions; Going from a computed imbalance of 2.5276859567851735E-5 to a new imbalance of 7.506794044531634E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.001888888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:17,249 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1342624397:83 , srv1607652359:83 , srv1665917259:83 , srv357504579:83 , srv438610747:83 , srv505092709:83 , srv893023278:83 , srv1033071468:84 , srv1036035474:84 , srv1043223148:84 , srv1046682607:84 , srv1127821264:84 , srv113323279:84 , srv1146091705:84 , srv1291640007:84 , srv1321863232:84 , srv1355837102:84 , srv1425764612:84 , srv1459146105:84 , srv1486553406:84 , srv1505078924:84 , srv1506120871:84 , srv1508962643:84 , srv1518470506:84 , srv1526070968:84 , srv1559483756:84 , srv1580102432:84 , srv1581315053:84 , srv15877799:84 , srv1645229704:84 , srv1646612048:84 , srv1654828210:84 , srv1657972213:84 , srv1693682573:84 , srv1693698603:84 , srv1700747317:84 , srv1770988137:84 , srv1809580502:84 , srv1852749022:84 , srv1863558821:84 , srv1893967974:84 , srv1972925642:84 , srv1976742876:84 , srv2003373376:84 , srv201190659:84 , srv2029711942:84 , srv2042667135:84 , srv20725895:84 , srv2075134966:84 , srv2090787072:84 , srv2113209414:84 , srv249971425:84 , srv280607259:84 , srv289994759:84 , srv29087901:84 , srv299297657:84 , srv334260619:84 , srv345332153:84 , srv347199:84 , srv39176239:84 , srv410166729:84 , srv436798428:84 , srv443267446:84 , srv465237326:84 , srv491013747:84 , srv52908386:84 , srv588346462:84 , srv588538272:84 , srv657159697:84 , srv675164970:84 , srv698080584:84 , srv730284121:84 , srv771421268:84 , srv781526698:84 , srv795939163:84 , srv810352264:84 , srv811598941:84 , srv812577862:84 , srv825348661:84 , srv856861896:84 , srv870740418:84 , srv874104104:84 , srv874186844:84 , srv882717653:84 , srv883835346:84 , srv887601334:84 , srv889712891:84 , srv890398451:84 , srv897974623:84 , srv90371565:84 , srv937076720:84 , srv996034645:84 , srv1072259356:85 , srv1345331802:85 , srv1514525652:85 , srv1632053308:85 , srv1993088393:85 , srv715988076:85 , srv72054912:85 , srv1212961067:684 }
2023-09-25 13:53:17,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:17,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486553406=16, srv289994759=55, srv1355837102=13, srv893023278=95, srv1863558821=40, srv795939163=81, srv2113209414=52, srv1809580502=38, srv2003373376=45, srv1770988137=37, srv299297657=57, srv870740418=87, srv1893967974=41, srv1127821264=5, srv1072259356=4, srv357504579=61, srv1693682573=34, srv825348661=85, srv1291640007=9, srv345332153=59, srv52908386=70, srv347199=60, srv410166729=63, srv1342624397=11, srv1425764612=14, srv29087901=56, srv1036035474=1, srv1043223148=2, srv72054912=77, srv1212961067=8, srv698080584=75, srv1508962643=19, srv438610747=65, srv505092709=69, srv1972925642=42, srv201190659=46, srv897974623=96, srv882717653=90, srv1033071468=0, srv1459146105=15, srv1976742876=43, srv1580102432=24, srv113323279=6, srv811598941=83, srv1146091705=7, srv90371565=97, srv1046682607=3, srv1345331802=12, srv781526698=80, srv1645229704=29, srv2029711942=47, srv334260619=58, srv887601334=92, srv436798428=64, srv1993088393=44, srv2042667135=48, srv1514525652=20, srv249971425=53, srv812577862=84, srv1526070968=22, srv280607259=54, srv1505078924=17, srv771421268=79, srv810352264=82, srv1665917259=33, srv1657972213=32, srv1581315053=25, srv1607652359=27, srv588538272=72, srv465237326=67, srv889712891=93, srv996034645=99, srv1506120871=18, srv588346462=71, srv874186844=89, srv856861896=86, srv1646612048=30, srv657159697=73, srv730284121=78, srv2090787072=51, srv491013747=68, srv715988076=76, srv20725895=49, srv443267446=66, srv937076720=98, srv1654828210=31, srv2075134966=50, srv1700747317=36, srv675164970=74, srv874104104=88, srv1321863232=10, srv1559483756=23, srv15877799=26, srv1632053308=28, srv883835346=91, srv1518470506=21, srv890398451=94, srv39176239=62, srv1693698603=35, srv1852749022=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:17,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:17,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 13:53:17,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 13:53:17,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 13:53:17,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 13:53:17,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 13:53:17,385 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:17,386 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1342624397:83 , srv1607652359:83 , srv1665917259:83 , srv357504579:83 , srv438610747:83 , srv505092709:83 , srv893023278:83 , srv1033071468:84 , srv1036035474:84 , srv1043223148:84 , srv1046682607:84 , srv1127821264:84 , srv113323279:84 , srv1146091705:84 , srv1291640007:84 , srv1321863232:84 , srv1355837102:84 , srv1425764612:84 , srv1459146105:84 , srv1486553406:84 , srv1505078924:84 , srv1506120871:84 , srv1508962643:84 , srv1518470506:84 , srv1526070968:84 , srv1559483756:84 , srv1580102432:84 , srv1581315053:84 , srv15877799:84 , srv1645229704:84 , srv1646612048:84 , srv1654828210:84 , srv1657972213:84 , srv1693682573:84 , srv1693698603:84 , srv1700747317:84 , srv1770988137:84 , srv1809580502:84 , srv1852749022:84 , srv1863558821:84 , srv1893967974:84 , srv1972925642:84 , srv1976742876:84 , srv2003373376:84 , srv201190659:84 , srv2029711942:84 , srv2042667135:84 , srv20725895:84 , srv2075134966:84 , srv2090787072:84 , srv2113209414:84 , srv249971425:84 , srv280607259:84 , srv289994759:84 , srv29087901:84 , srv299297657:84 , srv334260619:84 , srv345332153:84 , srv347199:84 , srv39176239:84 , srv410166729:84 , srv436798428:84 , srv443267446:84 , srv465237326:84 , srv491013747:84 , srv52908386:84 , srv588346462:84 , srv588538272:84 , srv657159697:84 , srv675164970:84 , srv698080584:84 , srv730284121:84 , srv771421268:84 , srv781526698:84 , srv795939163:84 , srv810352264:84 , srv811598941:84 , srv812577862:84 , srv825348661:84 , srv856861896:84 , srv870740418:84 , srv874104104:84 , srv874186844:84 , srv882717653:84 , srv883835346:84 , srv887601334:84 , srv889712891:84 , srv890398451:84 , srv897974623:84 , srv90371565:84 , srv937076720:84 , srv996034645:84 , srv1072259356:85 , srv1345331802:85 , srv1514525652:85 , srv1632053308:85 , srv1993088393:85 , srv715988076:85 , srv72054912:85 , srv1212961067:684 }
2023-09-25 13:53:17,412 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 279), ProcessCount=170 (was 170), AvailableMemoryMB=7954 (was 8580)
2023-09-25 13:53:17,420 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=170, AvailableMemoryMB=7954
2023-09-25 13:53:17,421 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 13:53:17,421 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-25 13:53:17,433 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1052485049:84 , srv1113740351:84 , srv1119181818:84 , srv1158019892:84 , srv1178546168:84 , srv1290891149:84 , srv130608770:84 , srv1329146942:84 , srv1587444024:84 , srv1611757497:84 , srv162678476:84 , srv1677345435:84 , srv1815729575:84 , srv1820428198:84 , srv1876759405:84 , srv1891255192:84 , srv2081735547:84 , srv228867161:84 , srv239262532:84 , srv253374439:84 , srv279083016:84 , srv311344388:84 , srv368890881:84 , srv587212164:84 , srv665653967:84 , srv749021991:84 , srv804558486:84 , srv818853286:84 , srv955129121:84 , srv1441487640:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-25 13:53:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:53:17,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1876759405=15, srv1119181818=2, srv665653967=25, srv955129121=29, srv1158019892=3, srv2081735547=17, srv130608770=6, srv279083016=21, srv1052485049=0, srv311344388=22, srv749021991=26, srv804558486=27, srv1820428198=14, srv1587444024=9, srv1891255192=16, srv1329146942=7, srv228867161=18, srv818853286=28, srv162678476=11, srv1441487640=8, srv368890881=23, srv587212164=24, srv1677345435=12, srv1290891149=5, srv1815729575=13, srv239262532=19, srv1113740351=1, srv1178546168=4, srv253374439=20, srv1611757497=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:53:17,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:53:17,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:53:17,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 13:53:17,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1317710537846009, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:53:17,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912608249552034, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1317710537846009, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-25 13:55:17,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5558021 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912608249552034 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:55:17,458 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1052485049:90 , srv1113740351:90 , srv1119181818:90 , srv1158019892:90 , srv1178546168:90 , srv1290891149:90 , srv130608770:90 , srv1329146942:90 , srv1441487640:90 , srv1587444024:90 , srv1611757497:90 , srv162678476:90 , srv1677345435:90 , srv1815729575:90 , srv1820428198:90 , srv1876759405:90 , srv1891255192:90 , srv2081735547:90 , srv228867161:90 , srv239262532:90 , srv253374439:90 , srv279083016:90 , srv311344388:90 , srv368890881:90 , srv587212164:90 , srv665653967:90 , srv749021991:90 , srv804558486:90 , srv818853286:90 , srv955129121:90 }
2023-09-25 13:55:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 13:55:17,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1876759405=15, srv1119181818=2, srv665653967=25, srv955129121=29, srv1158019892=3, srv2081735547=17, srv130608770=6, srv279083016=21, srv1052485049=0, srv311344388=22, srv749021991=26, srv804558486=27, srv1820428198=14, srv1587444024=9, srv1891255192=16, srv1329146942=7, srv228867161=18, srv818853286=28, srv162678476=11, srv1441487640=8, srv368890881=23, srv587212164=24, srv1677345435=12, srv1290891149=5, srv1815729575=13, srv239262532=19, srv1113740351=1, srv1178546168=4, srv253374439=20, srv1611757497=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 13:55:17,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 13:55:17,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 13:55:17,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 13:55:17,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 13:55:17,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 13:55:17,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 13:55:17,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 13:55:17,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 13:55:17,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 13:55:17,475 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 13:55:17,475 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1052485049:90 , srv1113740351:90 , srv1119181818:90 , srv1158019892:90 , srv1178546168:90 , srv1290891149:90 , srv130608770:90 , srv1329146942:90 , srv1441487640:90 , srv1587444024:90 , srv1611757497:90 , srv162678476:90 , srv1677345435:90 , srv1815729575:90 , srv1820428198:90 , srv1876759405:90 , srv1891255192:90 , srv2081735547:90 , srv228867161:90 , srv239262532:90 , srv253374439:90 , srv279083016:90 , srv311344388:90 , srv368890881:90 , srv587212164:90 , srv665653967:90 , srv749021991:90 , srv804558486:90 , srv818853286:90 , srv955129121:90 }
2023-09-25 13:55:17,487 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 279), ProcessCount=168 (was 170), AvailableMemoryMB=6775 (was 7954)