2023-02-08 08:55:53,800 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-02-08 08:55:54,109 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-02-08 08:55:54,214 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-02-08 08:55:54,268 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 08:55:54,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-08 08:55:54,287 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=168, AvailableMemoryMB=4842
2023-02-08 08:55:54,289 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 08:55:54,290 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-02-08 08:55:54,404 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048456395:84 , srv1068958747:84 , srv1093798711:84 , srv109733917:84 , srv1116260987:84 , srv1128795314:84 , srv1131145896:84 , srv1132148091:84 , srv1163528461:84 , srv1177100878:84 , srv119691706:84 , srv1205777200:84 , srv1234116019:84 , srv123754452:84 , srv1238833318:84 , srv1256919265:84 , srv1289748243:84 , srv1308426192:84 , srv1310299747:84 , srv131915228:84 , srv133250447:84 , srv1412476077:84 , srv1438392073:84 , srv1439167743:84 , srv1456177738:84 , srv1479070069:84 , srv1481028191:84 , srv1488700837:84 , srv1512588487:84 , srv1532384445:84 , srv1573061614:84 , srv157627013:84 , srv1578878197:84 , srv1627585255:84 , srv1673266221:84 , srv1689690561:84 , srv1720843525:84 , srv1768154826:84 , srv1806461327:84 , srv1809683407:84 , srv1856402952:84 , srv1879599608:84 , srv1897963261:84 , srv1901540050:84 , srv190921747:84 , srv1924170053:84 , srv1958268882:84 , srv2030806761:84 , srv2042855472:84 , srv2048820180:84 , srv2051349991:84 , srv2054610722:84 , srv2055088064:84 , srv2085547709:84 , srv274571701:84 , srv279980147:84 , srv309153958:84 , srv31942175:84 , srv321296416:84 , srv326139752:84 , srv329980001:84 , srv379939257:84 , srv390847702:84 , srv406817258:84 , srv413276148:84 , srv422803019:84 , srv446979687:84 , srv449602308:84 , srv4623162:84 , srv469396314:84 , srv480597866:84 , srv482434829:84 , srv507333624:84 , srv526120192:84 , srv530861757:84 , srv533681282:84 , srv546915810:84 , srv575629403:84 , srv581894894:84 , srv605355260:84 , srv635072349:84 , srv638962865:84 , srv669662166:84 , srv692497178:84 , srv715847378:84 , srv722739397:84 , srv748193731:84 , srv751379758:84 , srv755775639:84 , srv770391400:84 , srv78617900:84 , srv809928557:84 , srv826289818:84 , srv854886169:84 , srv8632328:84 , srv89539939:84 , srv950828038:84 , srv983548050:84 , srv996438494:84 , srv2106473955:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-02-08 08:55:54,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:54,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv446979687=67, srv1901540050=43, srv770391400=90, srv1177100878=9, srv605355260=80, srv1479070069=25, srv1481028191=26, srv329980001=61, srv1958268882=46, srv274571701=55, srv755775639=89, srv2051349991=50, srv1163528461=8, srv1068958747=1, srv722739397=86, srv157627013=31, srv78617900=91, srv482434829=72, srv575629403=78, srv390847702=63, srv131915228=19, srv1768154826=37, srv1438392073=22, srv309153958=57, srv1205777200=11, srv422803019=66, srv950828038=97, srv2055088064=52, srv546915810=77, srv669662166=83, srv8632328=95, srv406817258=64, srv530861757=75, srv2085547709=53, srv1116260987=4, srv133250447=20, srv1439167743=23, srv119691706=10, srv751379758=88, srv1048456395=0, srv507333624=73, srv1093798711=2, srv809928557=92, srv526120192=74, srv635072349=81, srv2054610722=51, srv2042855472=48, srv715847378=85, srv996438494=99, srv1238833318=14, srv89539939=96, srv326139752=60, srv279980147=56, srv1488700837=27, srv1512588487=28, srv1573061614=30, srv480597866=71, srv638962865=82, srv1412476077=21, srv109733917=3, srv2048820180=49, srv1689690561=35, srv1897963261=42, srv2030806761=47, srv1809683407=39, srv854886169=94, srv748193731=87, srv1234116019=12, srv533681282=76, srv1806461327=38, srv190921747=44, srv826289818=93, srv4623162=69, srv1128795314=5, srv692497178=84, srv581894894=79, srv1924170053=45, srv1532384445=29, srv1310299747=18, srv1289748243=16, srv413276148=65, srv983548050=98, srv469396314=70, srv1308426192=17, srv1856402952=40, srv1131145896=6, srv1132148091=7, srv123754452=13, srv1578878197=32, srv379939257=62, srv1456177738=24, srv449602308=68, srv1256919265=15, srv31942175=58, srv1627585255=33, srv1720843525=36, srv1879599608=41, srv2106473955=54, srv1673266221=34, srv321296416=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:54,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:54,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:54,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 08:55:54,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 08:55:54,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 08:55:54,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 08:55:54,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 08:55:54,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 08:55:54,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 08:55:54,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 08:55:54,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 08:55:54,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 08:55:54,666 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:54,667 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 08:55:54,667 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 08:55:54,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 409 ms to try 5000 different iterations.  Found a solution that moves 4701 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18201362056082512. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027867757035118, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546430104025994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5223333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027867757035118, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:54,947 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1532384445:82 , srv2055088064:82 , srv533681282:82 , srv1048456395:83 , srv1238833318:83 , srv1456177738:83 , srv190921747:83 , srv413276148:83 , srv575629403:83 , srv748193731:83 , srv751379758:83 , srv78617900:83 , srv950828038:83 , srv133250447:84 , srv1481028191:84 , srv1573061614:84 , srv1924170053:84 , srv605355260:84 , srv722739397:84 , srv826289818:84 , srv1068958747:85 , srv1116260987:85 , srv1131145896:85 , srv1163528461:85 , srv123754452:85 , srv1289748243:85 , srv1308426192:85 , srv1412476077:85 , srv157627013:85 , srv1768154826:85 , srv1901540050:85 , srv2054610722:85 , srv309153958:85 , srv321296416:85 , srv326139752:85 , srv390847702:85 , srv406817258:85 , srv4623162:85 , srv635072349:85 , srv669662166:85 , srv89539939:85 , srv983548050:85 , srv1177100878:86 , srv119691706:86 , srv1256919265:86 , srv1720843525:86 , srv1856402952:86 , srv2085547709:86 , srv482434829:86 , srv692497178:86 , srv770391400:86 , srv809928557:86 , srv1093798711:87 , srv109733917:87 , srv1128795314:87 , srv1438392073:87 , srv1479070069:87 , srv1488700837:87 , srv1512588487:87 , srv1673266221:87 , srv1689690561:87 , srv1809683407:87 , srv1897963261:87 , srv2030806761:87 , srv379939257:87 , srv446979687:87 , srv449602308:87 , srv507333624:87 , srv526120192:87 , srv530861757:87 , srv581894894:87 , srv8632328:87 , srv1205777200:88 , srv1310299747:88 , srv1578878197:88 , srv1879599608:88 , srv1958268882:88 , srv2042855472:88 , srv274571701:88 , srv546915810:88 , srv638962865:88 , srv1132148091:89 , srv131915228:89 , srv1806461327:89 , srv2048820180:89 , srv279980147:89 , srv329980001:89 , srv422803019:89 , srv715847378:89 , srv996438494:89 , srv1627585255:90 , srv469396314:90 , srv755775639:90 , srv1234116019:91 , srv1439167743:91 , srv480597866:91 , srv31942175:92 , srv854886169:93 , srv2051349991:97 , srv2106473955:448 }
2023-02-08 08:55:54,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:54,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv446979687=67, srv1901540050=43, srv770391400=90, srv1177100878=9, srv605355260=80, srv1479070069=25, srv1481028191=26, srv329980001=61, srv1958268882=46, srv274571701=55, srv755775639=89, srv2051349991=50, srv1163528461=8, srv1068958747=1, srv722739397=86, srv157627013=31, srv78617900=91, srv482434829=72, srv575629403=78, srv390847702=63, srv131915228=19, srv1768154826=37, srv1438392073=22, srv309153958=57, srv1205777200=11, srv422803019=66, srv950828038=97, srv2055088064=52, srv546915810=77, srv669662166=83, srv8632328=95, srv406817258=64, srv530861757=75, srv2085547709=53, srv1116260987=4, srv133250447=20, srv1439167743=23, srv119691706=10, srv751379758=88, srv1048456395=0, srv507333624=73, srv1093798711=2, srv809928557=92, srv526120192=74, srv635072349=81, srv2054610722=51, srv2042855472=48, srv715847378=85, srv996438494=99, srv1238833318=14, srv89539939=96, srv326139752=60, srv279980147=56, srv1488700837=27, srv1512588487=28, srv1573061614=30, srv480597866=71, srv638962865=82, srv1412476077=21, srv109733917=3, srv2048820180=49, srv1689690561=35, srv1897963261=42, srv2030806761=47, srv1809683407=39, srv854886169=94, srv748193731=87, srv1234116019=12, srv533681282=76, srv1806461327=38, srv190921747=44, srv826289818=93, srv4623162=69, srv1128795314=5, srv692497178=84, srv581894894=79, srv1924170053=45, srv1532384445=29, srv1310299747=18, srv1289748243=16, srv413276148=65, srv983548050=98, srv469396314=70, srv1308426192=17, srv1856402952=40, srv1131145896=6, srv1132148091=7, srv123754452=13, srv1578878197=32, srv379939257=62, srv1456177738=24, srv449602308=68, srv1256919265=15, srv31942175=58, srv1627585255=33, srv1720843525=36, srv1879599608=41, srv2106473955=54, srv1673266221=34, srv321296416=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:54,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:54,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:54,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:54,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:54,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:54,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 08:55:54,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 08:55:54,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 08:55:54,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 08:55:54,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 08:55:54,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 08:55:55,099 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027867757035118, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546430104025994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027867757035118, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:55,100 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 08:55:55,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1819807034552737, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04027867757035118, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0546430104025994, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04027867757035118, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17716666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 08:55:55,356 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 364 ms to try 5000 different iterations.  Found a solution that moves 2610 regions; Going from a computed imbalance of 0.1819807034552737 to a new imbalance of 0.016661918235986884. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02014970780257726); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029224929782006102, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02014970780257726); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:55,366 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2051349991:74 , srv31942175:78 , srv854886169:78 , srv1132148091:80 , srv1234116019:80 , srv279980147:80 , srv480597866:81 , srv1439167743:82 , srv1627585255:82 , srv1806461327:82 , srv2048820180:82 , srv329980001:82 , srv422803019:82 , srv131915228:83 , srv1479070069:83 , srv469396314:83 , srv715847378:83 , srv755775639:83 , srv996438494:83 , srv1205777200:84 , srv1438392073:84 , srv157627013:84 , srv1578878197:84 , srv1673266221:84 , srv2042855472:84 , srv530861757:84 , srv638962865:84 , srv109733917:85 , srv1163528461:85 , srv1256919265:85 , srv1310299747:85 , srv1720843525:85 , srv1897963261:85 , srv1958268882:85 , srv2030806761:85 , srv274571701:85 , srv379939257:85 , srv446979687:85 , srv526120192:85 , srv692497178:85 , srv770391400:85 , srv1068958747:86 , srv1128795314:86 , srv1131145896:86 , srv1177100878:86 , srv1488700837:86 , srv1512588487:86 , srv1768154826:86 , srv309153958:86 , srv406817258:86 , srv449602308:86 , srv4623162:86 , srv546915810:86 , srv722739397:86 , srv983548050:86 , srv1093798711:87 , srv119691706:87 , srv1573061614:87 , srv1689690561:87 , srv1879599608:87 , srv413276148:87 , srv482434829:87 , srv581894894:87 , srv605355260:87 , srv809928557:87 , srv826289818:87 , srv8632328:87 , srv89539939:87 , srv1116260987:88 , srv123754452:88 , srv1238833318:88 , srv133250447:88 , srv1809683407:88 , srv1901540050:88 , srv190921747:88 , srv1924170053:88 , srv2054610722:88 , srv2085547709:88 , srv326139752:88 , srv390847702:88 , srv507333624:88 , srv1289748243:89 , srv1308426192:89 , srv1412476077:89 , srv1456177738:89 , srv1481028191:89 , srv1856402952:89 , srv321296416:89 , srv575629403:89 , srv635072349:89 , srv748193731:89 , srv751379758:89 , srv1048456395:90 , srv1532384445:90 , srv533681282:90 , srv669662166:90 , srv2055088064:91 , srv78617900:91 , srv950828038:92 , srv2106473955:505 }
2023-02-08 08:55:55,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:55,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv446979687=67, srv1901540050=43, srv770391400=90, srv1177100878=9, srv605355260=80, srv1479070069=25, srv1481028191=26, srv329980001=61, srv1958268882=46, srv274571701=55, srv755775639=89, srv2051349991=50, srv1163528461=8, srv1068958747=1, srv722739397=86, srv157627013=31, srv78617900=91, srv482434829=72, srv575629403=78, srv390847702=63, srv131915228=19, srv1768154826=37, srv1438392073=22, srv309153958=57, srv1205777200=11, srv422803019=66, srv950828038=97, srv2055088064=52, srv546915810=77, srv669662166=83, srv8632328=95, srv406817258=64, srv530861757=75, srv2085547709=53, srv1116260987=4, srv133250447=20, srv1439167743=23, srv119691706=10, srv751379758=88, srv1048456395=0, srv507333624=73, srv1093798711=2, srv809928557=92, srv526120192=74, srv635072349=81, srv2054610722=51, srv2042855472=48, srv715847378=85, srv996438494=99, srv1238833318=14, srv89539939=96, srv326139752=60, srv279980147=56, srv1488700837=27, srv1512588487=28, srv1573061614=30, srv480597866=71, srv638962865=82, srv1412476077=21, srv109733917=3, srv2048820180=49, srv1689690561=35, srv1897963261=42, srv2030806761=47, srv1809683407=39, srv854886169=94, srv748193731=87, srv1234116019=12, srv533681282=76, srv1806461327=38, srv190921747=44, srv826289818=93, srv4623162=69, srv1128795314=5, srv692497178=84, srv581894894=79, srv1924170053=45, srv1532384445=29, srv1310299747=18, srv1289748243=16, srv413276148=65, srv983548050=98, srv469396314=70, srv1308426192=17, srv1856402952=40, srv1131145896=6, srv1132148091=7, srv123754452=13, srv1578878197=32, srv379939257=62, srv1456177738=24, srv449602308=68, srv1256919265=15, srv31942175=58, srv1627585255=33, srv1720843525=36, srv1879599608=41, srv2106473955=54, srv1673266221=34, srv321296416=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:55,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:55,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:55,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 08:55:55,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 08:55:55,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 08:55:55,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 08:55:55,386 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 08:55:55,387 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 08:55:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 08:55:55,388 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 08:55:55,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02014970780257726); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029224929782006102, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02014970780257726); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:55,510 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 08:55:55,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01664364262537443, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02014970780257726); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.029224929782006102, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02014970780257726); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01375); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044833333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 08:55:55,787 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 388 ms to try 5000 different iterations.  Found a solution that moves 1013 regions; Going from a computed imbalance of 0.01664364262537443 to a new imbalance of 6.241663105203552E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003431040862722423); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005080717713114865); MoveCostFunction : (multiplier=7.0, imbalance=0.11255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003431040862722423); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:55,788 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1308426192:83 , srv1809683407:83 , srv1856402952:83 , srv507333624:83 , srv669662166:83 , srv78617900:83 , srv950828038:83 , srv1093798711:84 , srv1128795314:84 , srv119691706:84 , srv1310299747:84 , srv1412476077:84 , srv1439167743:84 , srv1689690561:84 , srv1879599608:84 , srv1958268882:84 , srv321296416:84 , srv326139752:84 , srv482434829:84 , srv581894894:84 , srv635072349:84 , srv809928557:84 , srv8632328:84 , srv1048456395:85 , srv109733917:85 , srv1116260987:85 , srv1205777200:85 , srv123754452:85 , srv1289748243:85 , srv1481028191:85 , srv1488700837:85 , srv1512588487:85 , srv1532384445:85 , srv1897963261:85 , srv1901540050:85 , srv2030806761:85 , srv2055088064:85 , srv2085547709:85 , srv274571701:85 , srv379939257:85 , srv390847702:85 , srv449602308:85 , srv469396314:85 , srv526120192:85 , srv546915810:85 , srv751379758:85 , srv755775639:85 , srv1068958747:86 , srv1131145896:86 , srv1177100878:86 , srv1256919265:86 , srv131915228:86 , srv133250447:86 , srv1456177738:86 , srv1573061614:86 , srv1578878197:86 , srv1627585255:86 , srv1673266221:86 , srv1768154826:86 , srv1806461327:86 , srv190921747:86 , srv1924170053:86 , srv2042855472:86 , srv2051349991:86 , srv2054610722:86 , srv309153958:86 , srv329980001:86 , srv422803019:86 , srv446979687:86 , srv533681282:86 , srv575629403:86 , srv605355260:86 , srv638962865:86 , srv715847378:86 , srv826289818:86 , srv854886169:86 , srv89539939:86 , srv996438494:86 , srv1234116019:87 , srv1238833318:87 , srv1438392073:87 , srv1479070069:87 , srv1720843525:87 , srv2048820180:87 , srv31942175:87 , srv406817258:87 , srv4623162:87 , srv480597866:87 , srv530861757:87 , srv692497178:87 , srv722739397:87 , srv748193731:87 , srv770391400:87 , srv983548050:87 , srv1163528461:88 , srv157627013:88 , srv413276148:88 , srv1132148091:89 , srv279980147:89 , srv2106473955:535 }
2023-02-08 08:55:55,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:55,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv446979687=67, srv1901540050=43, srv770391400=90, srv1177100878=9, srv605355260=80, srv1479070069=25, srv1481028191=26, srv329980001=61, srv1958268882=46, srv274571701=55, srv755775639=89, srv2051349991=50, srv1163528461=8, srv1068958747=1, srv722739397=86, srv157627013=31, srv78617900=91, srv482434829=72, srv575629403=78, srv390847702=63, srv131915228=19, srv1768154826=37, srv1438392073=22, srv309153958=57, srv1205777200=11, srv422803019=66, srv950828038=97, srv2055088064=52, srv546915810=77, srv669662166=83, srv8632328=95, srv406817258=64, srv530861757=75, srv2085547709=53, srv1116260987=4, srv133250447=20, srv1439167743=23, srv119691706=10, srv751379758=88, srv1048456395=0, srv507333624=73, srv1093798711=2, srv809928557=92, srv526120192=74, srv635072349=81, srv2054610722=51, srv2042855472=48, srv715847378=85, srv996438494=99, srv1238833318=14, srv89539939=96, srv326139752=60, srv279980147=56, srv1488700837=27, srv1512588487=28, srv1573061614=30, srv480597866=71, srv638962865=82, srv1412476077=21, srv109733917=3, srv2048820180=49, srv1689690561=35, srv1897963261=42, srv2030806761=47, srv1809683407=39, srv854886169=94, srv748193731=87, srv1234116019=12, srv533681282=76, srv1806461327=38, srv190921747=44, srv826289818=93, srv4623162=69, srv1128795314=5, srv692497178=84, srv581894894=79, srv1924170053=45, srv1532384445=29, srv1310299747=18, srv1289748243=16, srv413276148=65, srv983548050=98, srv469396314=70, srv1308426192=17, srv1856402952=40, srv1131145896=6, srv1132148091=7, srv123754452=13, srv1578878197=32, srv379939257=62, srv1456177738=24, srv449602308=68, srv1256919265=15, srv31942175=58, srv1627585255=33, srv1720843525=36, srv1879599608=41, srv2106473955=54, srv1673266221=34, srv321296416=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:55,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:55,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:55,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:55,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 08:55:55,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 08:55:55,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 08:55:55,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 08:55:55,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 08:55:55,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 08:55:55,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 08:55:55,930 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003431040862722423); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005080717713114865); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003431040862722423); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:55,930 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-02-08 08:55:55,931 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.170731329148302E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.003431040862722423); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005080717713114865); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.003431040862722423); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0030833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-02-08 08:55:56,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 382 ms to try 5000 different iterations.  Found a solution that moves 214 regions; Going from a computed imbalance of 6.170731329148302E-4 to a new imbalance of 1.941196863747412E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.023777777777777776); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:56,213 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048456395:83 , srv1163528461:83 , srv1238833318:83 , srv1289748243:83 , srv2054610722:83 , srv2085547709:83 , srv480597866:83 , srv546915810:83 , srv575629403:83 , srv748193731:83 , srv983548050:83 , srv1093798711:84 , srv1116260987:84 , srv1132148091:84 , srv1177100878:84 , srv119691706:84 , srv123754452:84 , srv131915228:84 , srv133250447:84 , srv1412476077:84 , srv1438392073:84 , srv1456177738:84 , srv1481028191:84 , srv1488700837:84 , srv1512588487:84 , srv1578878197:84 , srv1627585255:84 , srv1689690561:84 , srv1720843525:84 , srv1809683407:84 , srv1856402952:84 , srv1879599608:84 , srv1901540050:84 , srv1924170053:84 , srv2042855472:84 , srv2055088064:84 , srv274571701:84 , srv279980147:84 , srv390847702:84 , srv413276148:84 , srv446979687:84 , srv449602308:84 , srv4623162:84 , srv469396314:84 , srv507333624:84 , srv530861757:84 , srv533681282:84 , srv581894894:84 , srv635072349:84 , srv638962865:84 , srv692497178:84 , srv715847378:84 , srv722739397:84 , srv755775639:84 , srv770391400:84 , srv854886169:84 , srv8632328:84 , srv89539939:84 , srv950828038:84 , srv996438494:84 , srv1068958747:85 , srv109733917:85 , srv1128795314:85 , srv1131145896:85 , srv1205777200:85 , srv1234116019:85 , srv1256919265:85 , srv1308426192:85 , srv1310299747:85 , srv1439167743:85 , srv1532384445:85 , srv1573061614:85 , srv157627013:85 , srv1673266221:85 , srv1768154826:85 , srv1806461327:85 , srv1897963261:85 , srv190921747:85 , srv1958268882:85 , srv2030806761:85 , srv2048820180:85 , srv2051349991:85 , srv31942175:85 , srv321296416:85 , srv326139752:85 , srv329980001:85 , srv379939257:85 , srv406817258:85 , srv422803019:85 , srv482434829:85 , srv526120192:85 , srv605355260:85 , srv669662166:85 , srv751379758:85 , srv78617900:85 , srv809928557:85 , srv826289818:85 , srv1479070069:86 , srv309153958:86 , srv2106473955:654 }
2023-02-08 08:55:56,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:56,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv446979687=67, srv1901540050=43, srv770391400=90, srv1177100878=9, srv605355260=80, srv1479070069=25, srv1481028191=26, srv329980001=61, srv1958268882=46, srv274571701=55, srv755775639=89, srv2051349991=50, srv1163528461=8, srv1068958747=1, srv722739397=86, srv157627013=31, srv78617900=91, srv482434829=72, srv575629403=78, srv390847702=63, srv131915228=19, srv1768154826=37, srv1438392073=22, srv309153958=57, srv1205777200=11, srv422803019=66, srv950828038=97, srv2055088064=52, srv546915810=77, srv669662166=83, srv8632328=95, srv406817258=64, srv530861757=75, srv2085547709=53, srv1116260987=4, srv133250447=20, srv1439167743=23, srv119691706=10, srv751379758=88, srv1048456395=0, srv507333624=73, srv1093798711=2, srv809928557=92, srv526120192=74, srv635072349=81, srv2054610722=51, srv2042855472=48, srv715847378=85, srv996438494=99, srv1238833318=14, srv89539939=96, srv326139752=60, srv279980147=56, srv1488700837=27, srv1512588487=28, srv1573061614=30, srv480597866=71, srv638962865=82, srv1412476077=21, srv109733917=3, srv2048820180=49, srv1689690561=35, srv1897963261=42, srv2030806761=47, srv1809683407=39, srv854886169=94, srv748193731=87, srv1234116019=12, srv533681282=76, srv1806461327=38, srv190921747=44, srv826289818=93, srv4623162=69, srv1128795314=5, srv692497178=84, srv581894894=79, srv1924170053=45, srv1532384445=29, srv1310299747=18, srv1289748243=16, srv413276148=65, srv983548050=98, srv469396314=70, srv1308426192=17, srv1856402952=40, srv1131145896=6, srv1132148091=7, srv123754452=13, srv1578878197=32, srv379939257=62, srv1456177738=24, srv449602308=68, srv1256919265=15, srv31942175=58, srv1627585255=33, srv1720843525=36, srv1879599608=41, srv2106473955=54, srv1673266221=34, srv321296416=59} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:56,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:56,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-02-08 08:55:56,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-02-08 08:55:56,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-02-08 08:55:56,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-02-08 08:55:56,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-02-08 08:55:56,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-02-08 08:55:56,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-02-08 08:55:56,344 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.7913508610245763E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:56,344 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048456395:83 , srv1163528461:83 , srv1238833318:83 , srv1289748243:83 , srv2054610722:83 , srv2085547709:83 , srv480597866:83 , srv546915810:83 , srv575629403:83 , srv748193731:83 , srv983548050:83 , srv1093798711:84 , srv1116260987:84 , srv1132148091:84 , srv1177100878:84 , srv119691706:84 , srv123754452:84 , srv131915228:84 , srv133250447:84 , srv1412476077:84 , srv1438392073:84 , srv1456177738:84 , srv1481028191:84 , srv1488700837:84 , srv1512588487:84 , srv1578878197:84 , srv1627585255:84 , srv1689690561:84 , srv1720843525:84 , srv1809683407:84 , srv1856402952:84 , srv1879599608:84 , srv1901540050:84 , srv1924170053:84 , srv2042855472:84 , srv2055088064:84 , srv274571701:84 , srv279980147:84 , srv390847702:84 , srv413276148:84 , srv446979687:84 , srv449602308:84 , srv4623162:84 , srv469396314:84 , srv507333624:84 , srv530861757:84 , srv533681282:84 , srv581894894:84 , srv635072349:84 , srv638962865:84 , srv692497178:84 , srv715847378:84 , srv722739397:84 , srv755775639:84 , srv770391400:84 , srv854886169:84 , srv8632328:84 , srv89539939:84 , srv950828038:84 , srv996438494:84 , srv1068958747:85 , srv109733917:85 , srv1128795314:85 , srv1131145896:85 , srv1205777200:85 , srv1234116019:85 , srv1256919265:85 , srv1308426192:85 , srv1310299747:85 , srv1439167743:85 , srv1532384445:85 , srv1573061614:85 , srv157627013:85 , srv1673266221:85 , srv1768154826:85 , srv1806461327:85 , srv1897963261:85 , srv190921747:85 , srv1958268882:85 , srv2030806761:85 , srv2048820180:85 , srv2051349991:85 , srv31942175:85 , srv321296416:85 , srv326139752:85 , srv329980001:85 , srv379939257:85 , srv406817258:85 , srv422803019:85 , srv482434829:85 , srv526120192:85 , srv605355260:85 , srv669662166:85 , srv751379758:85 , srv78617900:85 , srv809928557:85 , srv826289818:85 , srv1479070069:86 , srv309153958:86 , srv2106473955:654 }
2023-02-08 08:55:56,373 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 126), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=4352 (was 4842)
2023-02-08 08:55:56,380 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=170, AvailableMemoryMB=4352
2023-02-08 08:55:56,380 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-02-08 08:55:56,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-02-08 08:55:56,389 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1031175487:84 , srv1084460985:84 , srv1125627929:84 , srv115246799:84 , srv1228429947:84 , srv1358763892:84 , srv1477594536:84 , srv1522308868:84 , srv1593729166:84 , srv1730559197:84 , srv173127263:84 , srv1759876449:84 , srv1777096233:84 , srv2077333125:84 , srv223624396:84 , srv228961996:84 , srv298129635:84 , srv357586867:84 , srv373096704:84 , srv403747596:84 , srv428658507:84 , srv555720319:84 , srv619006309:84 , srv651962731:84 , srv797658408:84 , srv822128201:84 , srv883945683:84 , srv885797182:84 , srv964839271:84 , srv48508187:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-02-08 08:55:56,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:55:56,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1228429947=4, srv1777096233=12, srv373096704=18, srv883945683=27, srv115246799=3, srv2077333125=13, srv223624396=14, srv1031175487=0, srv651962731=24, srv228961996=15, srv48508187=21, srv1084460985=1, srv428658507=20, srv298129635=16, srv1125627929=2, srv1477594536=6, srv822128201=26, srv1358763892=5, srv555720319=22, srv173127263=10, srv1522308868=7, srv885797182=28, srv1730559197=9, srv357586867=17, srv403747596=19, srv1759876449=11, srv797658408=25, srv964839271=29, srv1593729166=8, srv619006309=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:55:56,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:55:56,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:55:56,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:55:56,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-08 08:55:56,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1379435007319794, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:55:56,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912627698730816, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1379435007319794, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-02-08 08:57:56,402 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6229700 different iterations.  Found a solution that moves 1865 regions; Going from a computed imbalance of 0.9912627698730816 to a new imbalance of 4.353003038599517E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6907407407407408, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:57:56,409 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1031175487:90 , srv1084460985:90 , srv1125627929:90 , srv115246799:90 , srv1228429947:90 , srv1358763892:90 , srv1477594536:90 , srv1522308868:90 , srv1593729166:90 , srv1730559197:90 , srv173127263:90 , srv1759876449:90 , srv1777096233:90 , srv2077333125:90 , srv223624396:90 , srv228961996:90 , srv298129635:90 , srv357586867:90 , srv373096704:90 , srv403747596:90 , srv428658507:90 , srv48508187:90 , srv555720319:90 , srv619006309:90 , srv651962731:90 , srv797658408:90 , srv822128201:90 , srv883945683:90 , srv885797182:90 , srv964839271:90 }
2023-02-08 08:57:56,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-02-08 08:57:56,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1228429947=4, srv1777096233=12, srv373096704=18, srv883945683=27, srv115246799=3, srv2077333125=13, srv223624396=14, srv1031175487=0, srv651962731=24, srv228961996=15, srv48508187=21, srv1084460985=1, srv428658507=20, srv298129635=16, srv1125627929=2, srv1477594536=6, srv822128201=26, srv1358763892=5, srv555720319=22, srv173127263=10, srv1522308868=7, srv885797182=28, srv1730559197=9, srv357586867=17, srv403747596=19, srv1759876449=11, srv797658408=25, srv964839271=29, srv1593729166=8, srv619006309=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-02-08 08:57:56,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-02-08 08:57:56,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-02-08 08:57:56,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-02-08 08:57:56,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-02-08 08:57:56,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-02-08 08:57:56,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-02-08 08:57:56,434 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-02-08 08:57:56,435 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1031175487:90 , srv1084460985:90 , srv1125627929:90 , srv115246799:90 , srv1228429947:90 , srv1358763892:90 , srv1477594536:90 , srv1522308868:90 , srv1593729166:90 , srv1730559197:90 , srv173127263:90 , srv1759876449:90 , srv1777096233:90 , srv2077333125:90 , srv223624396:90 , srv228961996:90 , srv298129635:90 , srv357586867:90 , srv373096704:90 , srv403747596:90 , srv428658507:90 , srv48508187:90 , srv555720319:90 , srv619006309:90 , srv651962731:90 , srv797658408:90 , srv822128201:90 , srv883945683:90 , srv885797182:90 , srv964839271:90 }
2023-02-08 08:57:56,449 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 126) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=4068 (was 4352)