2023-07-19 23:53:12,605 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-19 23:53:12,929 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-19 23:53:13,038 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-19 23:53:13,106 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 23:53:13,115 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-19 23:53:13,129 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=173, AvailableMemoryMB=7466
2023-07-19 23:53:13,132 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 23:53:13,132 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-19 23:53:13,277 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010549634:84 , srv1021558394:84 , srv1023355249:84 , srv1030151853:84 , srv1033365895:84 , srv1046708976:84 , srv1076741041:84 , srv1082761519:84 , srv1127665826:84 , srv1127909882:84 , srv1145759522:84 , srv1167766871:84 , srv1176850433:84 , srv1234587664:84 , srv123747650:84 , srv1246511139:84 , srv127294875:84 , srv1313018446:84 , srv1336720145:84 , srv1342714032:84 , srv134927029:84 , srv1363947482:84 , srv1414807124:84 , srv1419440133:84 , srv1482546156:84 , srv1498509294:84 , srv1505020594:84 , srv150980212:84 , srv1518046028:84 , srv1552746117:84 , srv1552772479:84 , srv1557390192:84 , srv1593246811:84 , srv1596506121:84 , srv162022047:84 , srv1642398397:84 , srv1691563072:84 , srv1704055742:84 , srv1719085959:84 , srv1720579159:84 , srv1730707325:84 , srv1750839366:84 , srv1779067721:84 , srv1779141495:84 , srv1792194273:84 , srv1800545084:84 , srv180444200:84 , srv1810811148:84 , srv184899633:84 , srv1852178556:84 , srv1952127708:84 , srv1961791470:84 , srv1987395160:84 , srv1988996076:84 , srv2009734910:84 , srv2019545752:84 , srv2036707268:84 , srv2037952577:84 , srv2040109034:84 , srv2056402939:84 , srv2060004916:84 , srv2061191854:84 , srv2069279150:84 , srv2074241446:84 , srv234832938:84 , srv237613895:84 , srv25962799:84 , srv275892851:84 , srv29829503:84 , srv299127576:84 , srv302851890:84 , srv355661636:84 , srv356625467:84 , srv414992987:84 , srv439470488:84 , srv518059070:84 , srv554542476:84 , srv577278869:84 , srv581140866:84 , srv581142254:84 , srv587705554:84 , srv611920755:84 , srv614088860:84 , srv642717680:84 , srv654370273:84 , srv685865028:84 , srv691622325:84 , srv711515704:84 , srv730863953:84 , srv746805275:84 , srv78376344:84 , srv815873998:84 , srv867549697:84 , srv887411265:84 , srv90778364:84 , srv91077925:84 , srv918233758:84 , srv948592869:84 , srv973109398:84 , srv1637959278:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-19 23:53:13,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:13,298 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv685865028=86, srv973109398=99, srv1852178556=50, srv91077925=96, srv1082761519=7, srv356625467=73, srv691622325=87, srv1691563072=37, srv614088860=83, srv815873998=92, srv1363947482=21, srv180444200=47, srv1779067721=43, srv1336720145=18, srv2019545752=56, srv1076741041=6, srv1246511139=15, srv1127909882=9, srv2009734910=55, srv1023355249=2, srv654370273=85, srv1518046028=28, srv1419440133=23, srv2074241446=64, srv1719085959=39, srv1313018446=17, srv642717680=84, srv25962799=67, srv1557390192=31, srv554542476=77, srv581140866=79, srv1498509294=25, srv948592869=98, srv1414807124=22, srv1988996076=54, srv439470488=75, srv581142254=80, srv2036707268=57, srv355661636=72, srv1810811148=48, srv127294875=16, srv1010549634=0, srv1342714032=19, srv134927029=20, srv414992987=74, srv150980212=27, srv1800545084=46, srv1596506121=33, srv2037952577=58, srv1987395160=53, srv577278869=78, srv1482546156=24, srv302851890=71, srv1046708976=5, srv1593246811=32, srv1952127708=51, srv1033365895=4, srv1145759522=10, srv2056402939=60, srv1704055742=38, srv611920755=82, srv1021558394=1, srv587705554=81, srv1552772479=30, srv711515704=88, srv746805275=90, srv78376344=91, srv2040109034=59, srv1792194273=45, srv299127576=70, srv1720579159=40, srv1961791470=52, srv29829503=69, srv1552746117=29, srv518059070=76, srv2069279150=63, srv1730707325=41, srv1779141495=44, srv918233758=97, srv1505020594=26, srv1167766871=11, srv184899633=49, srv1642398397=36, srv2060004916=61, srv887411265=94, srv234832938=65, srv162022047=34, srv1176850433=12, srv90778364=95, srv237613895=66, srv730863953=89, srv2061191854=62, srv867549697=93, srv1637959278=35, srv1750839366=42, srv275892851=68, srv1127665826=8, srv123747650=14, srv1030151853=3, srv1234587664=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:13,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:13,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:13,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:13,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 23:53:13,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 23:53:13,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 23:53:13,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 23:53:13,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 23:53:13,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 23:53:13,389 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 23:53:13,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 23:53:13,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:13,565 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 23:53:13,565 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 23:53:13,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 564 ms to try 5000 different iterations.  Found a solution that moves 4704 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17861137718236006. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038815226049688796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0520489280301805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5226666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038815226049688796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24308333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:13,986 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1482546156:82 , srv1720579159:82 , srv1961791470:82 , srv355661636:82 , srv611920755:82 , srv642717680:82 , srv918233758:82 , srv1336720145:83 , srv1691563072:83 , srv948592869:83 , srv1246511139:84 , srv1642398397:84 , srv1750839366:84 , srv1779141495:84 , srv180444200:84 , srv1810811148:84 , srv1852178556:84 , srv2037952577:84 , srv867549697:84 , srv1010549634:85 , srv1021558394:85 , srv1030151853:85 , srv1127909882:85 , srv127294875:85 , srv1552772479:85 , srv1593246811:85 , srv1800545084:85 , srv414992987:85 , srv554542476:85 , srv577278869:85 , srv1023355249:86 , srv1167766871:86 , srv1176850433:86 , srv1414807124:86 , srv1505020594:86 , srv1518046028:86 , srv1557390192:86 , srv1704055742:86 , srv1779067721:86 , srv184899633:86 , srv2040109034:86 , srv2074241446:86 , srv275892851:86 , srv711515704:86 , srv746805275:86 , srv78376344:86 , srv1046708976:87 , srv1076741041:87 , srv1082761519:87 , srv1127665826:87 , srv1313018446:87 , srv1363947482:87 , srv1419440133:87 , srv150980212:87 , srv1596506121:87 , srv162022047:87 , srv1730707325:87 , srv1987395160:87 , srv2019545752:87 , srv2036707268:87 , srv2060004916:87 , srv234832938:87 , srv237613895:87 , srv29829503:87 , srv439470488:87 , srv518059070:87 , srv581140866:87 , srv581142254:87 , srv614088860:87 , srv654370273:87 , srv685865028:87 , srv691622325:87 , srv887411265:87 , srv123747650:88 , srv1498509294:88 , srv1552746117:88 , srv1792194273:88 , srv2056402939:88 , srv2061191854:88 , srv25962799:88 , srv302851890:88 , srv815873998:88 , srv90778364:88 , srv91077925:88 , srv1033365895:89 , srv1719085959:89 , srv2009734910:89 , srv2069279150:89 , srv299127576:89 , srv587705554:89 , srv1342714032:90 , srv134927029:90 , srv1988996076:90 , srv730863953:90 , srv1952127708:91 , srv1234587664:92 , srv1145759522:93 , srv356625467:93 , srv973109398:95 , srv1637959278:435 }
2023-07-19 23:53:13,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:13,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv685865028=86, srv973109398=99, srv1852178556=50, srv91077925=96, srv1082761519=7, srv356625467=73, srv691622325=87, srv1691563072=37, srv614088860=83, srv815873998=92, srv1363947482=21, srv180444200=47, srv1779067721=43, srv1336720145=18, srv2019545752=56, srv1076741041=6, srv1246511139=15, srv1127909882=9, srv2009734910=55, srv1023355249=2, srv654370273=85, srv1518046028=28, srv1419440133=23, srv2074241446=64, srv1719085959=39, srv1313018446=17, srv642717680=84, srv25962799=67, srv1557390192=31, srv554542476=77, srv581140866=79, srv1498509294=25, srv948592869=98, srv1414807124=22, srv1988996076=54, srv439470488=75, srv581142254=80, srv2036707268=57, srv355661636=72, srv1810811148=48, srv127294875=16, srv1010549634=0, srv1342714032=19, srv134927029=20, srv414992987=74, srv150980212=27, srv1800545084=46, srv1596506121=33, srv2037952577=58, srv1987395160=53, srv577278869=78, srv1482546156=24, srv302851890=71, srv1046708976=5, srv1593246811=32, srv1952127708=51, srv1033365895=4, srv1145759522=10, srv2056402939=60, srv1704055742=38, srv611920755=82, srv1021558394=1, srv587705554=81, srv1552772479=30, srv711515704=88, srv746805275=90, srv78376344=91, srv2040109034=59, srv1792194273=45, srv299127576=70, srv1720579159=40, srv1961791470=52, srv29829503=69, srv1552746117=29, srv518059070=76, srv2069279150=63, srv1730707325=41, srv1779141495=44, srv918233758=97, srv1505020594=26, srv1167766871=11, srv184899633=49, srv1642398397=36, srv2060004916=61, srv887411265=94, srv234832938=65, srv162022047=34, srv1176850433=12, srv90778364=95, srv237613895=66, srv730863953=89, srv2061191854=62, srv867549697=93, srv1637959278=35, srv1750839366=42, srv275892851=68, srv1127665826=8, srv123747650=14, srv1030151853=3, srv1234587664=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:14,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:14,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:14,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:14,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:14,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:14,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:14,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 23:53:14,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 23:53:14,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 23:53:14,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 23:53:14,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 23:53:14,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 23:53:14,188 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038815226049688796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0520489280301805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038815226049688796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24308333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:14,189 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 23:53:14,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17857843907035967, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038815226049688796, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0520489280301805, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038815226049688796, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17358333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24308333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 23:53:14,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 537 ms to try 5000 different iterations.  Found a solution that moves 2693 regions; Going from a computed imbalance of 0.17857843907035967 to a new imbalance of 0.015887018580517873. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032752515517548764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2992222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:14,583 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1145759522:77 , srv973109398:78 , srv1033365895:80 , srv25962799:80 , srv1234587664:81 , srv1719085959:81 , srv1952127708:81 , srv1988996076:81 , srv587705554:81 , srv1342714032:82 , srv1552746117:82 , srv2009734910:82 , srv2019545752:82 , srv2069279150:82 , srv356625467:82 , srv1498509294:83 , srv2060004916:83 , srv237613895:83 , srv654370273:83 , srv730863953:83 , srv90778364:83 , srv1046708976:84 , srv1127665826:84 , srv123747650:84 , srv1419440133:84 , srv162022047:84 , srv1792194273:84 , srv184899633:84 , srv1987395160:84 , srv2056402939:84 , srv439470488:84 , srv518059070:84 , srv711515704:84 , srv91077925:84 , srv1082761519:85 , srv1127909882:85 , srv1167766871:85 , srv1313018446:85 , srv134927029:85 , srv1414807124:85 , srv1552772479:85 , srv1596506121:85 , srv1704055742:85 , srv1800545084:85 , srv2061191854:85 , srv275892851:85 , srv299127576:85 , srv302851890:85 , srv577278869:85 , srv614088860:85 , srv887411265:85 , srv1030151853:86 , srv1363947482:86 , srv1505020594:86 , srv1518046028:86 , srv1557390192:86 , srv1730707325:86 , srv1750839366:86 , srv1779067721:86 , srv1779141495:86 , srv1810811148:86 , srv2036707268:86 , srv581140866:86 , srv581142254:86 , srv691622325:86 , srv78376344:86 , srv815873998:86 , srv1076741041:87 , srv1176850433:87 , srv150980212:87 , srv180444200:87 , srv2040109034:87 , srv29829503:87 , srv685865028:87 , srv746805275:87 , srv867549697:87 , srv1010549634:88 , srv1021558394:88 , srv1023355249:88 , srv1246511139:88 , srv127294875:88 , srv2074241446:88 , srv234832938:88 , srv1642398397:89 , srv1691563072:89 , srv1852178556:89 , srv2037952577:89 , srv355661636:89 , srv414992987:89 , srv554542476:89 , srv918233758:89 , srv1336720145:90 , srv1482546156:90 , srv1961791470:90 , srv611920755:90 , srv1593246811:91 , srv1720579159:91 , srv948592869:92 , srv642717680:93 , srv1637959278:539 }
2023-07-19 23:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv685865028=86, srv973109398=99, srv1852178556=50, srv91077925=96, srv1082761519=7, srv356625467=73, srv691622325=87, srv1691563072=37, srv614088860=83, srv815873998=92, srv1363947482=21, srv180444200=47, srv1779067721=43, srv1336720145=18, srv2019545752=56, srv1076741041=6, srv1246511139=15, srv1127909882=9, srv2009734910=55, srv1023355249=2, srv654370273=85, srv1518046028=28, srv1419440133=23, srv2074241446=64, srv1719085959=39, srv1313018446=17, srv642717680=84, srv25962799=67, srv1557390192=31, srv554542476=77, srv581140866=79, srv1498509294=25, srv948592869=98, srv1414807124=22, srv1988996076=54, srv439470488=75, srv581142254=80, srv2036707268=57, srv355661636=72, srv1810811148=48, srv127294875=16, srv1010549634=0, srv1342714032=19, srv134927029=20, srv414992987=74, srv150980212=27, srv1800545084=46, srv1596506121=33, srv2037952577=58, srv1987395160=53, srv577278869=78, srv1482546156=24, srv302851890=71, srv1046708976=5, srv1593246811=32, srv1952127708=51, srv1033365895=4, srv1145759522=10, srv2056402939=60, srv1704055742=38, srv611920755=82, srv1021558394=1, srv587705554=81, srv1552772479=30, srv711515704=88, srv746805275=90, srv78376344=91, srv2040109034=59, srv1792194273=45, srv299127576=70, srv1720579159=40, srv1961791470=52, srv29829503=69, srv1552746117=29, srv518059070=76, srv2069279150=63, srv1730707325=41, srv1779141495=44, srv918233758=97, srv1505020594=26, srv1167766871=11, srv184899633=49, srv1642398397=36, srv2060004916=61, srv887411265=94, srv234832938=65, srv162022047=34, srv1176850433=12, srv90778364=95, srv237613895=66, srv730863953=89, srv2061191854=62, srv867549697=93, srv1637959278=35, srv1750839366=42, srv275892851=68, srv1127665826=8, srv123747650=14, srv1030151853=3, srv1234587664=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:14,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:14,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 23:53:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 23:53:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 23:53:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 23:53:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 23:53:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 23:53:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 23:53:14,769 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032752515517548764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:14,770 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 23:53:14,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01586816179148364, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022513799789134994); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032752515517548764, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022513799789134994); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01275); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04591666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 23:53:15,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 432 ms to try 5000 different iterations.  Found a solution that moves 1021 regions; Going from a computed imbalance of 0.01586816179148364 to a new imbalance of 4.288299109400917E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006321005190772531); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.11344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006321005190772531); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:15,095 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1593246811:82 , srv234832938:82 , srv948592869:82 , srv1023355249:83 , srv134927029:83 , srv2074241446:83 , srv299127576:83 , srv356625467:83 , srv554542476:83 , srv642717680:83 , srv685865028:83 , srv1010549634:84 , srv1021558394:84 , srv1076741041:84 , srv127294875:84 , srv1336720145:84 , srv1363947482:84 , srv150980212:84 , srv1596506121:84 , srv1720579159:84 , srv1730707325:84 , srv1852178556:84 , srv2040109034:84 , srv29829503:84 , srv302851890:84 , srv414992987:84 , srv581140866:84 , srv746805275:84 , srv973109398:84 , srv1176850433:85 , srv1234587664:85 , srv123747650:85 , srv1246511139:85 , srv1313018446:85 , srv1419440133:85 , srv1505020594:85 , srv1518046028:85 , srv1557390192:85 , srv1642398397:85 , srv1691563072:85 , srv1779067721:85 , srv2036707268:85 , srv2037952577:85 , srv2061191854:85 , srv581142254:85 , srv611920755:85 , srv691622325:85 , srv730863953:85 , srv815873998:85 , srv887411265:85 , srv91077925:85 , srv1030151853:86 , srv1082761519:86 , srv1167766871:86 , srv1342714032:86 , srv1482546156:86 , srv1498509294:86 , srv162022047:86 , srv1792194273:86 , srv184899633:86 , srv1952127708:86 , srv1961791470:86 , srv1987395160:86 , srv2056402939:86 , srv2069279150:86 , srv275892851:86 , srv355661636:86 , srv518059070:86 , srv614088860:86 , srv78376344:86 , srv867549697:86 , srv90778364:86 , srv1046708976:87 , srv1127665826:87 , srv1145759522:87 , srv1414807124:87 , srv1552746117:87 , srv1552772479:87 , srv1704055742:87 , srv1750839366:87 , srv1779141495:87 , srv1800545084:87 , srv180444200:87 , srv2060004916:87 , srv439470488:87 , srv577278869:87 , srv587705554:87 , srv918233758:87 , srv1033365895:88 , srv1127909882:88 , srv1719085959:88 , srv1810811148:88 , srv1988996076:88 , srv2009734910:88 , srv237613895:88 , srv654370273:88 , srv711515704:88 , srv2019545752:89 , srv25962799:89 , srv1637959278:540 }
2023-07-19 23:53:15,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:15,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv685865028=86, srv973109398=99, srv1852178556=50, srv91077925=96, srv1082761519=7, srv356625467=73, srv691622325=87, srv1691563072=37, srv614088860=83, srv815873998=92, srv1363947482=21, srv180444200=47, srv1779067721=43, srv1336720145=18, srv2019545752=56, srv1076741041=6, srv1246511139=15, srv1127909882=9, srv2009734910=55, srv1023355249=2, srv654370273=85, srv1518046028=28, srv1419440133=23, srv2074241446=64, srv1719085959=39, srv1313018446=17, srv642717680=84, srv25962799=67, srv1557390192=31, srv554542476=77, srv581140866=79, srv1498509294=25, srv948592869=98, srv1414807124=22, srv1988996076=54, srv439470488=75, srv581142254=80, srv2036707268=57, srv355661636=72, srv1810811148=48, srv127294875=16, srv1010549634=0, srv1342714032=19, srv134927029=20, srv414992987=74, srv150980212=27, srv1800545084=46, srv1596506121=33, srv2037952577=58, srv1987395160=53, srv577278869=78, srv1482546156=24, srv302851890=71, srv1046708976=5, srv1593246811=32, srv1952127708=51, srv1033365895=4, srv1145759522=10, srv2056402939=60, srv1704055742=38, srv611920755=82, srv1021558394=1, srv587705554=81, srv1552772479=30, srv711515704=88, srv746805275=90, srv78376344=91, srv2040109034=59, srv1792194273=45, srv299127576=70, srv1720579159=40, srv1961791470=52, srv29829503=69, srv1552746117=29, srv518059070=76, srv2069279150=63, srv1730707325=41, srv1779141495=44, srv918233758=97, srv1505020594=26, srv1167766871=11, srv184899633=49, srv1642398397=36, srv2060004916=61, srv887411265=94, srv234832938=65, srv162022047=34, srv1176850433=12, srv90778364=95, srv237613895=66, srv730863953=89, srv2061191854=62, srv867549697=93, srv1637959278=35, srv1750839366=42, srv275892851=68, srv1127665826=8, srv123747650=14, srv1030151853=3, srv1234587664=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:15,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:15,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:15,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 23:53:15,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 23:53:15,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 23:53:15,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 23:53:15,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 23:53:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 23:53:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 23:53:15,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 23:53:15,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 23:53:15,286 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006321005190772531); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006321005190772531); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:15,286 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-19 23:53:15,286 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.216807161372872E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006321005190772531); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006914582258636295); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006321005190772531); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-19 23:53:15,739 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 591 ms to try 5000 different iterations.  Found a solution that moves 225 regions; Going from a computed imbalance of 4.216807161372872E-4 to a new imbalance of 1.9619499089673262E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.025); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:15,740 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1342714032:83 , srv1952127708:83 , srv1988996076:83 , srv2009734910:83 , srv2037952577:83 , srv1046708976:84 , srv1076741041:84 , srv1127665826:84 , srv1127909882:84 , srv1167766871:84 , srv1176850433:84 , srv1234587664:84 , srv1246511139:84 , srv134927029:84 , srv1414807124:84 , srv1482546156:84 , srv1593246811:84 , srv1642398397:84 , srv1704055742:84 , srv1719085959:84 , srv1792194273:84 , srv180444200:84 , srv1810811148:84 , srv1961791470:84 , srv2019545752:84 , srv2036707268:84 , srv2056402939:84 , srv2061191854:84 , srv2069279150:84 , srv237613895:84 , srv25962799:84 , srv29829503:84 , srv356625467:84 , srv439470488:84 , srv581142254:84 , srv614088860:84 , srv642717680:84 , srv654370273:84 , srv691622325:84 , srv711515704:84 , srv730863953:84 , srv78376344:84 , srv815873998:84 , srv90778364:84 , srv1010549634:85 , srv1021558394:85 , srv1030151853:85 , srv1033365895:85 , srv1082761519:85 , srv1145759522:85 , srv123747650:85 , srv127294875:85 , srv1313018446:85 , srv1336720145:85 , srv1363947482:85 , srv1419440133:85 , srv1498509294:85 , srv1505020594:85 , srv150980212:85 , srv1552746117:85 , srv1552772479:85 , srv1557390192:85 , srv162022047:85 , srv1691563072:85 , srv1720579159:85 , srv1730707325:85 , srv1750839366:85 , srv1779067721:85 , srv1779141495:85 , srv1800545084:85 , srv1852178556:85 , srv1987395160:85 , srv2040109034:85 , srv2060004916:85 , srv2074241446:85 , srv234832938:85 , srv275892851:85 , srv299127576:85 , srv302851890:85 , srv414992987:85 , srv518059070:85 , srv554542476:85 , srv577278869:85 , srv581140866:85 , srv587705554:85 , srv611920755:85 , srv685865028:85 , srv746805275:85 , srv867549697:85 , srv887411265:85 , srv918233758:85 , srv948592869:85 , srv973109398:85 , srv1023355249:86 , srv1518046028:86 , srv1596506121:86 , srv184899633:86 , srv355661636:86 , srv91077925:86 , srv1637959278:628 }
2023-07-19 23:53:15,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:15,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv685865028=86, srv973109398=99, srv1852178556=50, srv91077925=96, srv1082761519=7, srv356625467=73, srv691622325=87, srv1691563072=37, srv614088860=83, srv815873998=92, srv1363947482=21, srv180444200=47, srv1779067721=43, srv1336720145=18, srv2019545752=56, srv1076741041=6, srv1246511139=15, srv1127909882=9, srv2009734910=55, srv1023355249=2, srv654370273=85, srv1518046028=28, srv1419440133=23, srv2074241446=64, srv1719085959=39, srv1313018446=17, srv642717680=84, srv25962799=67, srv1557390192=31, srv554542476=77, srv581140866=79, srv1498509294=25, srv948592869=98, srv1414807124=22, srv1988996076=54, srv439470488=75, srv581142254=80, srv2036707268=57, srv355661636=72, srv1810811148=48, srv127294875=16, srv1010549634=0, srv1342714032=19, srv134927029=20, srv414992987=74, srv150980212=27, srv1800545084=46, srv1596506121=33, srv2037952577=58, srv1987395160=53, srv577278869=78, srv1482546156=24, srv302851890=71, srv1046708976=5, srv1593246811=32, srv1952127708=51, srv1033365895=4, srv1145759522=10, srv2056402939=60, srv1704055742=38, srv611920755=82, srv1021558394=1, srv587705554=81, srv1552772479=30, srv711515704=88, srv746805275=90, srv78376344=91, srv2040109034=59, srv1792194273=45, srv299127576=70, srv1720579159=40, srv1961791470=52, srv29829503=69, srv1552746117=29, srv518059070=76, srv2069279150=63, srv1730707325=41, srv1779141495=44, srv918233758=97, srv1505020594=26, srv1167766871=11, srv184899633=49, srv1642398397=36, srv2060004916=61, srv887411265=94, srv234832938=65, srv162022047=34, srv1176850433=12, srv90778364=95, srv237613895=66, srv730863953=89, srv2061191854=62, srv867549697=93, srv1637959278=35, srv1750839366=42, srv275892851=68, srv1127665826=8, srv123747650=14, srv1030151853=3, srv1234587664=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:15,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:15,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:15,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:15,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:15,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:15,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:15,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-19 23:53:15,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-19 23:53:15,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-19 23:53:15,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-19 23:53:15,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-19 23:53:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-19 23:53:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-19 23:53:15,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-19 23:53:15,884 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8044015416185505E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:15,885 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1342714032:83 , srv1952127708:83 , srv1988996076:83 , srv2009734910:83 , srv2037952577:83 , srv1046708976:84 , srv1076741041:84 , srv1127665826:84 , srv1127909882:84 , srv1167766871:84 , srv1176850433:84 , srv1234587664:84 , srv1246511139:84 , srv134927029:84 , srv1414807124:84 , srv1482546156:84 , srv1593246811:84 , srv1642398397:84 , srv1704055742:84 , srv1719085959:84 , srv1792194273:84 , srv180444200:84 , srv1810811148:84 , srv1961791470:84 , srv2019545752:84 , srv2036707268:84 , srv2056402939:84 , srv2061191854:84 , srv2069279150:84 , srv237613895:84 , srv25962799:84 , srv29829503:84 , srv356625467:84 , srv439470488:84 , srv581142254:84 , srv614088860:84 , srv642717680:84 , srv654370273:84 , srv691622325:84 , srv711515704:84 , srv730863953:84 , srv78376344:84 , srv815873998:84 , srv90778364:84 , srv1010549634:85 , srv1021558394:85 , srv1030151853:85 , srv1033365895:85 , srv1082761519:85 , srv1145759522:85 , srv123747650:85 , srv127294875:85 , srv1313018446:85 , srv1336720145:85 , srv1363947482:85 , srv1419440133:85 , srv1498509294:85 , srv1505020594:85 , srv150980212:85 , srv1552746117:85 , srv1552772479:85 , srv1557390192:85 , srv162022047:85 , srv1691563072:85 , srv1720579159:85 , srv1730707325:85 , srv1750839366:85 , srv1779067721:85 , srv1779141495:85 , srv1800545084:85 , srv1852178556:85 , srv1987395160:85 , srv2040109034:85 , srv2060004916:85 , srv2074241446:85 , srv234832938:85 , srv275892851:85 , srv299127576:85 , srv302851890:85 , srv414992987:85 , srv518059070:85 , srv554542476:85 , srv577278869:85 , srv581140866:85 , srv587705554:85 , srv611920755:85 , srv685865028:85 , srv746805275:85 , srv867549697:85 , srv887411265:85 , srv918233758:85 , srv948592869:85 , srv973109398:85 , srv1023355249:86 , srv1518046028:86 , srv1596506121:86 , srv184899633:86 , srv355661636:86 , srv91077925:86 , srv1637959278:628 }
2023-07-19 23:53:15,915 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=6667 (was 7466)
2023-07-19 23:53:15,925 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=173, AvailableMemoryMB=6665
2023-07-19 23:53:15,926 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-19 23:53:15,926 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-19 23:53:15,940 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1077250709:84 , srv1089427701:84 , srv1153174891:84 , srv1155097218:84 , srv123185770:84 , srv1416312269:84 , srv1511490205:84 , srv1550961086:84 , srv1588183928:84 , srv1690228821:84 , srv1712629869:84 , srv1720904761:84 , srv1795120543:84 , srv2000078863:84 , srv2004484083:84 , srv203230730:84 , srv234927267:84 , srv27987933:84 , srv380803315:84 , srv388756705:84 , srv397685504:84 , srv426739199:84 , srv45594264:84 , srv467994342:84 , srv748260719:84 , srv792233536:84 , srv84737535:84 , srv901984511:84 , srv986666458:84 , srv1986679030:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-19 23:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:53:15,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004484083=15, srv123185770=4, srv426739199=22, srv2000078863=14, srv986666458=29, srv1550961086=7, srv380803315=19, srv84737535=27, srv901984511=28, srv1986679030=13, srv1089427701=1, srv45594264=23, srv388756705=20, srv467994342=24, srv1690228821=9, srv203230730=16, srv1712629869=10, srv234927267=17, srv1588183928=8, srv397685504=21, srv1416312269=5, srv1153174891=2, srv1795120543=12, srv1077250709=0, srv748260719=25, srv792233536=26, srv1155097218=3, srv1511490205=6, srv1720904761=11, srv27987933=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:53:15,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:53:15,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:53:15,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:53:15,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:53:15,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:53:15,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:53:15,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:53:15,957 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-19 23:53:15,984 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1274966084700795, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:53:15,985 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912594780914421, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1274966084700795, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-19 23:55:15,961 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5391205 different iterations.  Found a solution that moves 1867 regions; Going from a computed imbalance of 0.9912594780914421 to a new imbalance of 4.3576711383728133E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6914814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:55:15,969 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1077250709:90 , srv1089427701:90 , srv1153174891:90 , srv1155097218:90 , srv123185770:90 , srv1416312269:90 , srv1511490205:90 , srv1550961086:90 , srv1588183928:90 , srv1690228821:90 , srv1712629869:90 , srv1720904761:90 , srv1795120543:90 , srv1986679030:90 , srv2000078863:90 , srv2004484083:90 , srv203230730:90 , srv234927267:90 , srv27987933:90 , srv380803315:90 , srv388756705:90 , srv397685504:90 , srv426739199:90 , srv45594264:90 , srv467994342:90 , srv748260719:90 , srv792233536:90 , srv84737535:90 , srv901984511:90 , srv986666458:90 }
2023-07-19 23:55:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-19 23:55:15,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2004484083=15, srv123185770=4, srv426739199=22, srv2000078863=14, srv986666458=29, srv1550961086=7, srv380803315=19, srv84737535=27, srv901984511=28, srv1986679030=13, srv1089427701=1, srv45594264=23, srv388756705=20, srv467994342=24, srv1690228821=9, srv203230730=16, srv1712629869=10, srv234927267=17, srv1588183928=8, srv397685504=21, srv1416312269=5, srv1153174891=2, srv1795120543=12, srv1077250709=0, srv748260719=25, srv792233536=26, srv1155097218=3, srv1511490205=6, srv1720904761=11, srv27987933=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-19 23:55:15,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-19 23:55:15,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-19 23:55:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-19 23:55:15,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-19 23:55:15,990 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-19 23:55:15,990 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1077250709:90 , srv1089427701:90 , srv1153174891:90 , srv1155097218:90 , srv123185770:90 , srv1416312269:90 , srv1511490205:90 , srv1550961086:90 , srv1588183928:90 , srv1690228821:90 , srv1712629869:90 , srv1720904761:90 , srv1795120543:90 , srv1986679030:90 , srv2000078863:90 , srv2004484083:90 , srv203230730:90 , srv234927267:90 , srv27987933:90 , srv380803315:90 , srv388756705:90 , srv397685504:90 , srv426739199:90 , srv45594264:90 , srv467994342:90 , srv748260719:90 , srv792233536:90 , srv84737535:90 , srv901984511:90 , srv986666458:90 }
2023-07-19 23:55:16,003 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 308), ProcessCount=171 (was 173), AvailableMemoryMB=5761 (was 6665)