2023-09-04 07:53:12,954 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-04 07:53:13,281 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-04 07:53:13,394 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-04 07:53:13,469 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 07:53:13,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-04 07:53:13,490 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=338, ProcessCount=174, AvailableMemoryMB=10144
2023-09-04 07:53:13,492 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 07:53:13,492 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-04 07:53:13,649 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001464066:84 , srv1016078362:84 , srv1036911788:84 , srv1050863691:84 , srv1080563668:84 , srv1085737556:84 , srv1122512438:84 , srv1132868716:84 , srv113490891:84 , srv1145971108:84 , srv1187393001:84 , srv1197491294:84 , srv1222955841:84 , srv1240521598:84 , srv1250291768:84 , srv1264341543:84 , srv128192713:84 , srv1283254840:84 , srv129431376:84 , srv1295570787:84 , srv1317377402:84 , srv135062465:84 , srv1351219707:84 , srv1392744267:84 , srv1399675583:84 , srv1400990093:84 , srv1420835329:84 , srv1434660903:84 , srv1438302930:84 , srv1444427706:84 , srv1446944318:84 , srv1451265600:84 , srv1497597345:84 , srv1519278351:84 , srv15449963:84 , srv154878385:84 , srv1555987136:84 , srv1593567088:84 , srv1616265299:84 , srv1629751732:84 , srv1665175083:84 , srv1675659530:84 , srv1702534820:84 , srv1750844940:84 , srv175273392:84 , srv179096637:84 , srv1824393717:84 , srv1874091703:84 , srv1875242808:84 , srv1878600080:84 , srv1908437816:84 , srv194490823:84 , srv1957052276:84 , srv198847618:84 , srv1997324306:84 , srv2020189445:84 , srv2027834934:84 , srv2062602170:84 , srv207607358:84 , srv2125282851:84 , srv227271860:84 , srv240168675:84 , srv245923558:84 , srv27250066:84 , srv274155050:84 , srv299337720:84 , srv301386407:84 , srv302757008:84 , srv303257148:84 , srv308316659:84 , srv312248934:84 , srv312949321:84 , srv320913394:84 , srv367773095:84 , srv392174732:84 , srv39239889:84 , srv423939442:84 , srv441097675:84 , srv45358224:84 , srv477892902:84 , srv492638123:84 , srv53358558:84 , srv58053949:84 , srv624189887:84 , srv665359216:84 , srv679337223:84 , srv696049686:84 , srv697565987:84 , srv703540018:84 , srv725598259:84 , srv768690395:84 , srv780207302:84 , srv782902059:84 , srv788194682:84 , srv803207876:84 , srv810388200:84 , srv816005178:84 , srv903753839:84 , srv98700603:84 , srv1000415392:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-04 07:53:13,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1555987136=37, srv477892902=80, srv1446944318=31, srv1750844940=44, srv1001464066=1, srv1420835329=27, srv15449963=35, srv1145971108=10, srv303257148=69, srv1665175083=41, srv1264341543=16, srv1222955841=13, srv1874091703=48, srv1187393001=11, srv492638123=81, srv367773095=74, srv1132868716=8, srv301386407=67, srv302757008=68, srv1392744267=24, srv2020189445=56, srv1878600080=50, srv194490823=52, srv227271860=61, srv320913394=73, srv441097675=78, srv803207876=95, srv27250066=64, srv392174732=75, srv179096637=46, srv1444427706=30, srv53358558=82, srv725598259=90, srv113490891=9, srv1675659530=42, srv1497597345=33, srv768690395=91, srv1616265299=39, srv2027834934=57, srv308316659=70, srv274155050=65, srv1519278351=34, srv207607358=59, srv1295570787=20, srv1875242808=49, srv1824393717=47, srv703540018=89, srv780207302=92, srv1997324306=55, srv1036911788=3, srv1957052276=53, srv299337720=66, srv697565987=88, srv1438302930=29, srv1702534820=43, srv135062465=22, srv1283254840=18, srv1085737556=6, srv245923558=63, srv312248934=71, srv154878385=36, srv312949321=72, srv624189887=84, srv175273392=45, srv2062602170=58, srv198847618=54, srv39239889=76, srv58053949=83, srv98700603=99, srv1434660903=28, srv1400990093=26, srv810388200=96, srv1593567088=38, srv1351219707=23, srv45358224=79, srv1000415392=0, srv1629751732=40, srv679337223=86, srv1016078362=2, srv816005178=97, srv1050863691=4, srv1250291768=15, srv1317377402=21, srv1240521598=14, srv1908437816=51, srv129431376=19, srv2125282851=60, srv696049686=87, srv665359216=85, srv1080563668=5, srv903753839=98, srv128192713=17, srv1399675583=25, srv1122512438=7, srv240168675=62, srv788194682=94, srv1197491294=12, srv1451265600=32, srv423939442=77, srv782902059=93} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:13,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:13,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:13,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 07:53:13,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 07:53:13,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 07:53:13,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 07:53:13,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 07:53:13,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 07:53:13,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 07:53:13,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 07:53:13,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 07:53:13,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 07:53:13,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 07:53:13,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 07:53:14,055 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:14,056 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 07:53:14,056 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 07:53:14,468 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 653 ms to try 5000 different iterations.  Found a solution that moves 4707 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17815382120553555. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392662467576254, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05658044539721123, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.523, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392662467576254, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:14,503 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv308316659:81 , srv1878600080:82 , srv367773095:82 , srv1001464066:83 , srv1016078362:83 , srv1187393001:83 , srv1240521598:83 , srv1250291768:83 , srv1434660903:83 , srv27250066:83 , srv303257148:83 , srv53358558:83 , srv1085737556:84 , srv1122512438:84 , srv135062465:84 , srv1420835329:84 , srv1519278351:84 , srv154878385:84 , srv1702534820:84 , srv2125282851:84 , srv274155050:84 , srv113490891:85 , srv1283254840:85 , srv1295570787:85 , srv1399675583:85 , srv1400990093:85 , srv1438302930:85 , srv1446944318:85 , srv1593567088:85 , srv1616265299:85 , srv1629751732:85 , srv302757008:85 , srv45358224:85 , srv58053949:85 , srv697565987:85 , srv1036911788:86 , srv1132868716:86 , srv1197491294:86 , srv129431376:86 , srv1675659530:86 , srv179096637:86 , srv1824393717:86 , srv1875242808:86 , srv1908437816:86 , srv1957052276:86 , srv2020189445:86 , srv299337720:86 , srv312949321:86 , srv665359216:86 , srv725598259:86 , srv803207876:86 , srv816005178:86 , srv903753839:86 , srv1264341543:87 , srv1351219707:87 , srv1665175083:87 , srv1874091703:87 , srv194490823:87 , srv198847618:87 , srv1997324306:87 , srv2062602170:87 , srv227271860:87 , srv301386407:87 , srv320913394:87 , srv441097675:87 , srv492638123:87 , srv679337223:87 , srv696049686:87 , srv768690395:87 , srv782902059:87 , srv1080563668:88 , srv128192713:88 , srv1317377402:88 , srv1444427706:88 , srv39239889:88 , srv477892902:88 , srv624189887:88 , srv780207302:88 , srv98700603:88 , srv1050863691:89 , srv1145971108:89 , srv1392744267:89 , srv15449963:89 , srv1555987136:89 , srv1750844940:89 , srv240168675:89 , srv245923558:89 , srv788194682:89 , srv1451265600:90 , srv175273392:90 , srv312248934:90 , srv810388200:90 , srv1222955841:91 , srv207607358:91 , srv423939442:91 , srv1497597345:92 , srv392174732:92 , srv2027834934:93 , srv703540018:93 , srv1000415392:439 }
2023-09-04 07:53:14,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:14,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1555987136=37, srv477892902=80, srv1446944318=31, srv1750844940=44, srv1001464066=1, srv1420835329=27, srv15449963=35, srv1145971108=10, srv303257148=69, srv1665175083=41, srv1264341543=16, srv1222955841=13, srv1874091703=48, srv1187393001=11, srv492638123=81, srv367773095=74, srv1132868716=8, srv301386407=67, srv302757008=68, srv1392744267=24, srv2020189445=56, srv1878600080=50, srv194490823=52, srv227271860=61, srv320913394=73, srv441097675=78, srv803207876=95, srv27250066=64, srv392174732=75, srv179096637=46, srv1444427706=30, srv53358558=82, srv725598259=90, srv113490891=9, srv1675659530=42, srv1497597345=33, srv768690395=91, srv1616265299=39, srv2027834934=57, srv308316659=70, srv274155050=65, srv1519278351=34, srv207607358=59, srv1295570787=20, srv1875242808=49, srv1824393717=47, srv703540018=89, srv780207302=92, srv1997324306=55, srv1036911788=3, srv1957052276=53, srv299337720=66, srv697565987=88, srv1438302930=29, srv1702534820=43, srv135062465=22, srv1283254840=18, srv1085737556=6, srv245923558=63, srv312248934=71, srv154878385=36, srv312949321=72, srv624189887=84, srv175273392=45, srv2062602170=58, srv198847618=54, srv39239889=76, srv58053949=83, srv98700603=99, srv1434660903=28, srv1400990093=26, srv810388200=96, srv1593567088=38, srv1351219707=23, srv45358224=79, srv1000415392=0, srv1629751732=40, srv679337223=86, srv1016078362=2, srv816005178=97, srv1050863691=4, srv1250291768=15, srv1317377402=21, srv1240521598=14, srv1908437816=51, srv129431376=19, srv2125282851=60, srv696049686=87, srv665359216=85, srv1080563668=5, srv903753839=98, srv128192713=17, srv1399675583=25, srv1122512438=7, srv240168675=62, srv788194682=94, srv1197491294=12, srv1451265600=32, srv423939442=77, srv782902059=93} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:14,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:14,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:14,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:14,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:14,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:14,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:14,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 07:53:14,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 07:53:14,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 07:53:14,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 07:53:14,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 07:53:14,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 07:53:14,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 07:53:14,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 07:53:14,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 07:53:14,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 07:53:14,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 07:53:14,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392662467576254, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05658044539721123, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392662467576254, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:14,731 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 07:53:14,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1781208620870862, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0392662467576254, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05658044539721123, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0392662467576254, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17341666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23941666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 07:53:15,111 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 2561 regions; Going from a computed imbalance of 0.1781208620870862 to a new imbalance of 0.016157636746110662. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019704766939238127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28455555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019704766939238127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:15,125 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2027834934:80 , srv207607358:80 , srv1222955841:81 , srv1497597345:81 , srv392174732:81 , srv703540018:81 , srv1451265600:82 , srv245923558:82 , srv624189887:82 , srv780207302:82 , srv788194682:82 , srv128192713:83 , srv1317377402:83 , srv1392744267:83 , srv1444427706:83 , srv15449963:83 , srv1750844940:83 , srv312248934:83 , srv423939442:83 , srv810388200:83 , srv98700603:83 , srv1665175083:84 , srv175273392:84 , srv179096637:84 , srv1824393717:84 , srv2062602170:84 , srv477892902:84 , srv492638123:84 , srv665359216:84 , srv725598259:84 , srv768690395:84 , srv1050863691:85 , srv1197491294:85 , srv1264341543:85 , srv129431376:85 , srv1351219707:85 , srv1446944318:85 , srv1555987136:85 , srv1593567088:85 , srv1874091703:85 , srv198847618:85 , srv1997324306:85 , srv240168675:85 , srv302757008:85 , srv39239889:85 , srv441097675:85 , srv696049686:85 , srv697565987:85 , srv1080563668:86 , srv113490891:86 , srv1145971108:86 , srv1250291768:86 , srv1420835329:86 , srv1616265299:86 , srv1875242808:86 , srv1908437816:86 , srv194490823:86 , srv1957052276:86 , srv227271860:86 , srv312949321:86 , srv782902059:86 , srv1036911788:87 , srv1283254840:87 , srv1399675583:87 , srv154878385:87 , srv1675659530:87 , srv2020189445:87 , srv274155050:87 , srv320913394:87 , srv58053949:87 , srv679337223:87 , srv903753839:87 , srv1085737556:88 , srv1122512438:88 , srv1240521598:88 , srv1295570787:88 , srv135062465:88 , srv1400990093:88 , srv1434660903:88 , srv1629751732:88 , srv301386407:88 , srv45358224:88 , srv803207876:88 , srv1001464066:89 , srv1132868716:89 , srv1438302930:89 , srv1519278351:89 , srv303257148:89 , srv816005178:89 , srv1187393001:90 , srv1702534820:90 , srv1878600080:90 , srv2125282851:90 , srv27250066:90 , srv299337720:90 , srv53358558:90 , srv308316659:91 , srv367773095:91 , srv1016078362:92 , srv1000415392:510 }
2023-09-04 07:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1555987136=37, srv477892902=80, srv1446944318=31, srv1750844940=44, srv1001464066=1, srv1420835329=27, srv15449963=35, srv1145971108=10, srv303257148=69, srv1665175083=41, srv1264341543=16, srv1222955841=13, srv1874091703=48, srv1187393001=11, srv492638123=81, srv367773095=74, srv1132868716=8, srv301386407=67, srv302757008=68, srv1392744267=24, srv2020189445=56, srv1878600080=50, srv194490823=52, srv227271860=61, srv320913394=73, srv441097675=78, srv803207876=95, srv27250066=64, srv392174732=75, srv179096637=46, srv1444427706=30, srv53358558=82, srv725598259=90, srv113490891=9, srv1675659530=42, srv1497597345=33, srv768690395=91, srv1616265299=39, srv2027834934=57, srv308316659=70, srv274155050=65, srv1519278351=34, srv207607358=59, srv1295570787=20, srv1875242808=49, srv1824393717=47, srv703540018=89, srv780207302=92, srv1997324306=55, srv1036911788=3, srv1957052276=53, srv299337720=66, srv697565987=88, srv1438302930=29, srv1702534820=43, srv135062465=22, srv1283254840=18, srv1085737556=6, srv245923558=63, srv312248934=71, srv154878385=36, srv312949321=72, srv624189887=84, srv175273392=45, srv2062602170=58, srv198847618=54, srv39239889=76, srv58053949=83, srv98700603=99, srv1434660903=28, srv1400990093=26, srv810388200=96, srv1593567088=38, srv1351219707=23, srv45358224=79, srv1000415392=0, srv1629751732=40, srv679337223=86, srv1016078362=2, srv816005178=97, srv1050863691=4, srv1250291768=15, srv1317377402=21, srv1240521598=14, srv1908437816=51, srv129431376=19, srv2125282851=60, srv696049686=87, srv665359216=85, srv1080563668=5, srv903753839=98, srv128192713=17, srv1399675583=25, srv1122512438=7, srv240168675=62, srv788194682=94, srv1197491294=12, srv1451265600=32, srv423939442=77, srv782902059=93} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 07:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 07:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 07:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 07:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 07:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 07:53:15,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 07:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 07:53:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 07:53:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 07:53:15,289 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019704766939238127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019704766939238127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:15,289 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 07:53:15,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016139704240831543, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019704766939238127); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03274908862603872, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019704766939238127); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04741666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 07:53:15,584 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 404 ms to try 5000 different iterations.  Found a solution that moves 1007 regions; Going from a computed imbalance of 0.016139704240831543 to a new imbalance of 7.032493035266887E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00552516942673832); MoveCostFunction : (multiplier=7.0, imbalance=0.11188888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:15,586 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1016078362:82 , srv299337720:82 , srv1050863691:83 , srv1080563668:83 , srv1132868716:83 , srv1145971108:83 , srv1438302930:83 , srv1555987136:83 , srv2125282851:83 , srv301386407:83 , srv320913394:83 , srv423939442:83 , srv703540018:83 , srv803207876:83 , srv816005178:83 , srv1036911788:84 , srv1187393001:84 , srv1497597345:84 , srv1519278351:84 , srv1702534820:84 , srv175273392:84 , srv194490823:84 , srv2020189445:84 , srv2027834934:84 , srv227271860:84 , srv240168675:84 , srv27250066:84 , srv312248934:84 , srv39239889:84 , srv53358558:84 , srv679337223:84 , srv782902059:84 , srv810388200:84 , srv1001464066:85 , srv1122512438:85 , srv1264341543:85 , srv1295570787:85 , srv1351219707:85 , srv1392744267:85 , srv1399675583:85 , srv1400990093:85 , srv1451265600:85 , srv1629751732:85 , srv1675659530:85 , srv1750844940:85 , srv1874091703:85 , srv1878600080:85 , srv1908437816:85 , srv1957052276:85 , srv1997324306:85 , srv303257148:85 , srv308316659:85 , srv312949321:85 , srv367773095:85 , srv392174732:85 , srv45358224:85 , srv58053949:85 , srv1085737556:86 , srv113490891:86 , srv1222955841:86 , srv1283254840:86 , srv1317377402:86 , srv135062465:86 , srv15449963:86 , srv154878385:86 , srv1875242808:86 , srv198847618:86 , srv245923558:86 , srv274155050:86 , srv477892902:86 , srv696049686:86 , srv788194682:86 , srv903753839:86 , srv98700603:86 , srv1197491294:87 , srv1240521598:87 , srv128192713:87 , srv129431376:87 , srv1420835329:87 , srv1434660903:87 , srv1444427706:87 , srv1446944318:87 , srv1616265299:87 , srv2062602170:87 , srv207607358:87 , srv441097675:87 , srv492638123:87 , srv768690395:87 , srv780207302:87 , srv1250291768:88 , srv1665175083:88 , srv179096637:88 , srv1824393717:88 , srv302757008:88 , srv624189887:88 , srv665359216:88 , srv697565987:88 , srv725598259:88 , srv1593567088:89 , srv1000415392:557 }
2023-09-04 07:53:15,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:15,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1555987136=37, srv477892902=80, srv1446944318=31, srv1750844940=44, srv1001464066=1, srv1420835329=27, srv15449963=35, srv1145971108=10, srv303257148=69, srv1665175083=41, srv1264341543=16, srv1222955841=13, srv1874091703=48, srv1187393001=11, srv492638123=81, srv367773095=74, srv1132868716=8, srv301386407=67, srv302757008=68, srv1392744267=24, srv2020189445=56, srv1878600080=50, srv194490823=52, srv227271860=61, srv320913394=73, srv441097675=78, srv803207876=95, srv27250066=64, srv392174732=75, srv179096637=46, srv1444427706=30, srv53358558=82, srv725598259=90, srv113490891=9, srv1675659530=42, srv1497597345=33, srv768690395=91, srv1616265299=39, srv2027834934=57, srv308316659=70, srv274155050=65, srv1519278351=34, srv207607358=59, srv1295570787=20, srv1875242808=49, srv1824393717=47, srv703540018=89, srv780207302=92, srv1997324306=55, srv1036911788=3, srv1957052276=53, srv299337720=66, srv697565987=88, srv1438302930=29, srv1702534820=43, srv135062465=22, srv1283254840=18, srv1085737556=6, srv245923558=63, srv312248934=71, srv154878385=36, srv312949321=72, srv624189887=84, srv175273392=45, srv2062602170=58, srv198847618=54, srv39239889=76, srv58053949=83, srv98700603=99, srv1434660903=28, srv1400990093=26, srv810388200=96, srv1593567088=38, srv1351219707=23, srv45358224=79, srv1000415392=0, srv1629751732=40, srv679337223=86, srv1016078362=2, srv816005178=97, srv1050863691=4, srv1250291768=15, srv1317377402=21, srv1240521598=14, srv1908437816=51, srv129431376=19, srv2125282851=60, srv696049686=87, srv665359216=85, srv1080563668=5, srv903753839=98, srv128192713=17, srv1399675583=25, srv1122512438=7, srv240168675=62, srv788194682=94, srv1197491294=12, srv1451265600=32, srv423939442=77, srv782902059=93} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 07:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 07:53:15,612 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 07:53:15,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 07:53:15,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 07:53:15,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 07:53:15,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 07:53:15,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 07:53:15,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 07:53:15,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00552516942673832); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:15,747 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-04 07:53:15,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.961981388191234E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054249519356559806); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00552516942673832); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054249519356559806); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-04 07:53:16,145 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 507 ms to try 5000 different iterations.  Found a solution that moves 219 regions; Going from a computed imbalance of 6.961981388191234E-4 to a new imbalance of 1.926728532830818E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.024333333333333332); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:16,146 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1593567088:83 , srv1665175083:83 , srv441097675:83 , srv903753839:83 , srv1085737556:84 , srv1132868716:84 , srv1145971108:84 , srv1197491294:84 , srv1222955841:84 , srv1240521598:84 , srv128192713:84 , srv129431376:84 , srv1295570787:84 , srv135062465:84 , srv1392744267:84 , srv1400990093:84 , srv1434660903:84 , srv1444427706:84 , srv15449963:84 , srv1616265299:84 , srv1629751732:84 , srv1675659530:84 , srv1702534820:84 , srv1750844940:84 , srv175273392:84 , srv179096637:84 , srv1824393717:84 , srv1875242808:84 , srv198847618:84 , srv2062602170:84 , srv207607358:84 , srv2125282851:84 , srv240168675:84 , srv299337720:84 , srv301386407:84 , srv302757008:84 , srv367773095:84 , srv392174732:84 , srv45358224:84 , srv477892902:84 , srv492638123:84 , srv58053949:84 , srv624189887:84 , srv665359216:84 , srv679337223:84 , srv696049686:84 , srv697565987:84 , srv768690395:84 , srv780207302:84 , srv816005178:84 , srv1001464066:85 , srv1016078362:85 , srv1050863691:85 , srv1080563668:85 , srv1122512438:85 , srv113490891:85 , srv1250291768:85 , srv1264341543:85 , srv1283254840:85 , srv1317377402:85 , srv1351219707:85 , srv1399675583:85 , srv1420835329:85 , srv1438302930:85 , srv1446944318:85 , srv1451265600:85 , srv1497597345:85 , srv154878385:85 , srv1555987136:85 , srv1874091703:85 , srv1878600080:85 , srv1908437816:85 , srv194490823:85 , srv1957052276:85 , srv1997324306:85 , srv2020189445:85 , srv2027834934:85 , srv227271860:85 , srv245923558:85 , srv27250066:85 , srv274155050:85 , srv303257148:85 , srv308316659:85 , srv312248934:85 , srv312949321:85 , srv320913394:85 , srv39239889:85 , srv423939442:85 , srv53358558:85 , srv703540018:85 , srv725598259:85 , srv782902059:85 , srv788194682:85 , srv803207876:85 , srv810388200:85 , srv98700603:85 , srv1036911788:86 , srv1187393001:86 , srv1519278351:86 , srv1000415392:636 }
2023-09-04 07:53:16,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:16,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1555987136=37, srv477892902=80, srv1446944318=31, srv1750844940=44, srv1001464066=1, srv1420835329=27, srv15449963=35, srv1145971108=10, srv303257148=69, srv1665175083=41, srv1264341543=16, srv1222955841=13, srv1874091703=48, srv1187393001=11, srv492638123=81, srv367773095=74, srv1132868716=8, srv301386407=67, srv302757008=68, srv1392744267=24, srv2020189445=56, srv1878600080=50, srv194490823=52, srv227271860=61, srv320913394=73, srv441097675=78, srv803207876=95, srv27250066=64, srv392174732=75, srv179096637=46, srv1444427706=30, srv53358558=82, srv725598259=90, srv113490891=9, srv1675659530=42, srv1497597345=33, srv768690395=91, srv1616265299=39, srv2027834934=57, srv308316659=70, srv274155050=65, srv1519278351=34, srv207607358=59, srv1295570787=20, srv1875242808=49, srv1824393717=47, srv703540018=89, srv780207302=92, srv1997324306=55, srv1036911788=3, srv1957052276=53, srv299337720=66, srv697565987=88, srv1438302930=29, srv1702534820=43, srv135062465=22, srv1283254840=18, srv1085737556=6, srv245923558=63, srv312248934=71, srv154878385=36, srv312949321=72, srv624189887=84, srv175273392=45, srv2062602170=58, srv198847618=54, srv39239889=76, srv58053949=83, srv98700603=99, srv1434660903=28, srv1400990093=26, srv810388200=96, srv1593567088=38, srv1351219707=23, srv45358224=79, srv1000415392=0, srv1629751732=40, srv679337223=86, srv1016078362=2, srv816005178=97, srv1050863691=4, srv1250291768=15, srv1317377402=21, srv1240521598=14, srv1908437816=51, srv129431376=19, srv2125282851=60, srv696049686=87, srv665359216=85, srv1080563668=5, srv903753839=98, srv128192713=17, srv1399675583=25, srv1122512438=7, srv240168675=62, srv788194682=94, srv1197491294=12, srv1451265600=32, srv423939442=77, srv782902059=93} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:16,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:16,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:16,173 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-04 07:53:16,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-04 07:53:16,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-04 07:53:16,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-04 07:53:16,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-04 07:53:16,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-04 07:53:16,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-04 07:53:16,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-04 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-04 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-04 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-04 07:53:16,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-04 07:53:16,318 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7733814552780093E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:16,318 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1593567088:83 , srv1665175083:83 , srv441097675:83 , srv903753839:83 , srv1085737556:84 , srv1132868716:84 , srv1145971108:84 , srv1197491294:84 , srv1222955841:84 , srv1240521598:84 , srv128192713:84 , srv129431376:84 , srv1295570787:84 , srv135062465:84 , srv1392744267:84 , srv1400990093:84 , srv1434660903:84 , srv1444427706:84 , srv15449963:84 , srv1616265299:84 , srv1629751732:84 , srv1675659530:84 , srv1702534820:84 , srv1750844940:84 , srv175273392:84 , srv179096637:84 , srv1824393717:84 , srv1875242808:84 , srv198847618:84 , srv2062602170:84 , srv207607358:84 , srv2125282851:84 , srv240168675:84 , srv299337720:84 , srv301386407:84 , srv302757008:84 , srv367773095:84 , srv392174732:84 , srv45358224:84 , srv477892902:84 , srv492638123:84 , srv58053949:84 , srv624189887:84 , srv665359216:84 , srv679337223:84 , srv696049686:84 , srv697565987:84 , srv768690395:84 , srv780207302:84 , srv816005178:84 , srv1001464066:85 , srv1016078362:85 , srv1050863691:85 , srv1080563668:85 , srv1122512438:85 , srv113490891:85 , srv1250291768:85 , srv1264341543:85 , srv1283254840:85 , srv1317377402:85 , srv1351219707:85 , srv1399675583:85 , srv1420835329:85 , srv1438302930:85 , srv1446944318:85 , srv1451265600:85 , srv1497597345:85 , srv154878385:85 , srv1555987136:85 , srv1874091703:85 , srv1878600080:85 , srv1908437816:85 , srv194490823:85 , srv1957052276:85 , srv1997324306:85 , srv2020189445:85 , srv2027834934:85 , srv227271860:85 , srv245923558:85 , srv27250066:85 , srv274155050:85 , srv303257148:85 , srv308316659:85 , srv312248934:85 , srv312949321:85 , srv320913394:85 , srv39239889:85 , srv423939442:85 , srv53358558:85 , srv703540018:85 , srv725598259:85 , srv782902059:85 , srv788194682:85 , srv803207876:85 , srv810388200:85 , srv98700603:85 , srv1036911788:86 , srv1187393001:86 , srv1519278351:86 , srv1000415392:636 }
2023-09-04 07:53:16,346 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=375 (was 338) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=9344 (was 10144)
2023-09-04 07:53:16,357 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=375, ProcessCount=174, AvailableMemoryMB=9343
2023-09-04 07:53:16,357 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-04 07:53:16,358 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-04 07:53:16,366 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026605473:84 , srv1044723888:84 , srv1078986503:84 , srv1099407029:84 , srv1130403461:84 , srv1253024623:84 , srv1419459721:84 , srv1453581070:84 , srv1589687627:84 , srv1600345142:84 , srv1629981725:84 , srv1709345976:84 , srv1715543467:84 , srv1796329451:84 , srv1820557525:84 , srv1854113054:84 , srv1860065857:84 , srv1880769951:84 , srv1964429096:84 , srv1965566541:84 , srv316041703:84 , srv511038173:84 , srv556299318:84 , srv594118847:84 , srv701042613:84 , srv713452559:84 , srv799899024:84 , srv987870490:84 , srv988121872:84 , srv1767394779:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-04 07:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:53:16,367 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv713452559=26, srv1130403461=4, srv1964429096=19, srv316041703=21, srv988121872=29, srv1715543467=12, srv701042613=25, srv1419459721=6, srv1709345976=11, srv1600345142=9, srv1820557525=15, srv987870490=28, srv1965566541=20, srv1453581070=7, srv1629981725=10, srv594118847=24, srv1796329451=14, srv1854113054=16, srv1078986503=2, srv1860065857=17, srv556299318=23, srv1044723888=1, srv511038173=22, srv1767394779=13, srv1880769951=18, srv1099407029=3, srv1253024623=5, srv1589687627=8, srv1026605473=0, srv799899024=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:53:16,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:53:16,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:53:16,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-04 07:53:16,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0483268104642227, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:53:16,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912345319466038, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0483268104642227, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-04 07:55:16,382 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5771825 different iterations.  Found a solution that moves 1868 regions; Going from a computed imbalance of 0.9912345319466038 to a new imbalance of 4.360005188259462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6918518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:55:16,388 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026605473:90 , srv1044723888:90 , srv1078986503:90 , srv1099407029:90 , srv1130403461:90 , srv1253024623:90 , srv1419459721:90 , srv1453581070:90 , srv1589687627:90 , srv1600345142:90 , srv1629981725:90 , srv1709345976:90 , srv1715543467:90 , srv1767394779:90 , srv1796329451:90 , srv1820557525:90 , srv1854113054:90 , srv1860065857:90 , srv1880769951:90 , srv1964429096:90 , srv1965566541:90 , srv316041703:90 , srv511038173:90 , srv556299318:90 , srv594118847:90 , srv701042613:90 , srv713452559:90 , srv799899024:90 , srv987870490:90 , srv988121872:90 }
2023-09-04 07:55:16,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-04 07:55:16,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv713452559=26, srv1130403461=4, srv1964429096=19, srv316041703=21, srv988121872=29, srv1715543467=12, srv701042613=25, srv1419459721=6, srv1709345976=11, srv1600345142=9, srv1820557525=15, srv987870490=28, srv1965566541=20, srv1453581070=7, srv1629981725=10, srv594118847=24, srv1796329451=14, srv1854113054=16, srv1078986503=2, srv1860065857=17, srv556299318=23, srv1044723888=1, srv511038173=22, srv1767394779=13, srv1880769951=18, srv1099407029=3, srv1253024623=5, srv1589687627=8, srv1026605473=0, srv799899024=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-04 07:55:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-04 07:55:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-04 07:55:16,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-04 07:55:16,406 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026605473:90 , srv1044723888:90 , srv1078986503:90 , srv1099407029:90 , srv1130403461:90 , srv1253024623:90 , srv1419459721:90 , srv1453581070:90 , srv1589687627:90 , srv1600345142:90 , srv1629981725:90 , srv1709345976:90 , srv1715543467:90 , srv1767394779:90 , srv1796329451:90 , srv1820557525:90 , srv1854113054:90 , srv1860065857:90 , srv1880769951:90 , srv1964429096:90 , srv1965566541:90 , srv316041703:90 , srv511038173:90 , srv556299318:90 , srv594118847:90 , srv701042613:90 , srv713452559:90 , srv799899024:90 , srv987870490:90 , srv988121872:90 }
2023-09-04 07:55:16,419 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 375), ProcessCount=171 (was 174), AvailableMemoryMB=9595 (was 9343) - AvailableMemoryMB LEAK? -