2023-03-03 11:57:00,315 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-03 11:57:00,641 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-03 11:57:00,761 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-03 11:57:00,825 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 11:57:00,832 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 11:57:00,846 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=164, AvailableMemoryMB=9608
2023-03-03 11:57:00,848 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 11:57:00,849 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 11:57:01,021 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002752982:84 , srv1011911933:84 , srv1083154294:84 , srv1104390085:84 , srv1180692512:84 , srv1192693072:84 , srv1242837006:84 , srv1243797080:84 , srv1246670184:84 , srv1253059703:84 , srv133169656:84 , srv1345114039:84 , srv1345944060:84 , srv1356094946:84 , srv1411714888:84 , srv1424132243:84 , srv1433529593:84 , srv1453953539:84 , srv1454123045:84 , srv1474714564:84 , srv1486425747:84 , srv1488451071:84 , srv1507071121:84 , srv1508698775:84 , srv1550968179:84 , srv1559940290:84 , srv1569371739:84 , srv1588510896:84 , srv163580272:84 , srv1640299563:84 , srv1640646806:84 , srv1643531535:84 , srv1670744558:84 , srv1725010272:84 , srv1739722863:84 , srv1758056853:84 , srv1763346478:84 , srv1764904452:84 , srv1797937072:84 , srv1804079275:84 , srv1878111708:84 , srv1898748581:84 , srv1912547450:84 , srv1951561663:84 , srv1963741888:84 , srv1998831027:84 , srv2005036969:84 , srv2005694968:84 , srv2010445131:84 , srv2015813296:84 , srv2034935267:84 , srv2067670115:84 , srv2068209429:84 , srv2070552231:84 , srv2072615380:84 , srv2098300838:84 , srv2111976958:84 , srv2123228634:84 , srv2124072935:84 , srv293036771:84 , srv308659410:84 , srv34299926:84 , srv354529898:84 , srv36301499:84 , srv36948762:84 , srv369857077:84 , srv407105733:84 , srv416998357:84 , srv442434980:84 , srv526516878:84 , srv542078012:84 , srv564194003:84 , srv572969798:84 , srv582942254:84 , srv598659627:84 , srv608065466:84 , srv619548312:84 , srv641971485:84 , srv652799037:84 , srv682397509:84 , srv694709970:84 , srv733120541:84 , srv744702499:84 , srv748911943:84 , srv752325096:84 , srv756426673:84 , srv761647853:84 , srv77202797:84 , srv802456893:84 , srv81071029:84 , srv830643461:84 , srv832385435:84 , srv866938317:84 , srv867807498:84 , srv891766121:84 , srv89252756:84 , srv944174752:84 , srv961141034:84 , srv996041807:84 , srv668947395:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-03 11:57:01,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:01,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:01,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:01,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:01,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:01,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:01,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:01,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:01,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:01,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:01,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:01,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:01,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:01,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:01,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:01,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:01,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:01,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:01,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:01,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:01,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:01,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:01,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:01,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:01,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:01,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:01,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:01,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:01,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:01,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:01,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:01,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:01,176 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:01,177 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:01,178 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:01,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:01,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:01,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:01,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:01,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:01,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:01,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:01,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:01,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:01,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:01,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:01,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:01,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:01,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:01,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:01,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:01,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:01,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:01,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:01,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:01,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:01,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:01,424 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 11:57:01,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 11:57:01,742 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 497 ms to try 5000 different iterations.  Found a solution that moves 4718 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17626273627817657. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03713555919637584, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055397755690803956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5242222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03713555919637584, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:01,755 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1356094946:82 , srv1424132243:82 , srv2015813296:82 , srv163580272:83 , srv1804079275:83 , srv2123228634:83 , srv744702499:83 , srv1002752982:84 , srv1242837006:84 , srv1453953539:84 , srv1454123045:84 , srv1474714564:84 , srv1507071121:84 , srv1550968179:84 , srv1725010272:84 , srv1797937072:84 , srv1898748581:84 , srv1912547450:84 , srv1345114039:85 , srv1488451071:85 , srv1739722863:85 , srv2005694968:85 , srv2072615380:85 , srv2124072935:85 , srv354529898:85 , srv36948762:85 , srv526516878:85 , srv682397509:85 , srv694709970:85 , srv756426673:85 , srv761647853:85 , srv867807498:85 , srv1011911933:86 , srv1433529593:86 , srv1569371739:86 , srv1588510896:86 , srv1640299563:86 , srv1670744558:86 , srv1758056853:86 , srv1763346478:86 , srv2005036969:86 , srv36301499:86 , srv369857077:86 , srv442434980:86 , srv572969798:86 , srv608065466:86 , srv752325096:86 , srv832385435:86 , srv891766121:86 , srv89252756:86 , srv961141034:86 , srv1083154294:87 , srv1180692512:87 , srv1192693072:87 , srv1246670184:87 , srv133169656:87 , srv1411714888:87 , srv1508698775:87 , srv1764904452:87 , srv1878111708:87 , srv1951561663:87 , srv2010445131:87 , srv2068209429:87 , srv407105733:87 , srv652799037:87 , srv733120541:87 , srv944174752:87 , srv996041807:87 , srv1345944060:88 , srv1559940290:88 , srv1640646806:88 , srv1963741888:88 , srv2034935267:88 , srv2070552231:88 , srv2098300838:88 , srv293036771:88 , srv582942254:88 , srv802456893:88 , srv81071029:88 , srv830643461:88 , srv1253059703:89 , srv1643531535:89 , srv2111976958:89 , srv34299926:89 , srv542078012:89 , srv619548312:89 , srv77202797:89 , srv1104390085:90 , srv308659410:90 , srv564194003:90 , srv866938317:90 , srv2067670115:91 , srv416998357:91 , srv598659627:91 , srv1486425747:92 , srv641971485:92 , srv748911943:92 , srv1998831027:93 , srv1243797080:94 , srv668947395:420 }
2023-03-03 11:57:01,760 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:01,761 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:01,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:01,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:01,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:01,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:01,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:01,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:01,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:01,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:01,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:01,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:01,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:01,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:01,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:01,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:01,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:01,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:01,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03713555919637584, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055397755690803956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03713555919637584, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:01,913 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 11:57:01,913 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17622970013608094, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03713555919637584, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055397755690803956, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03713555919637584, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17158333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23691666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 11:57:02,130 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 311 ms to try 5000 different iterations.  Found a solution that moves 2609 regions; Going from a computed imbalance of 0.17622970013608094 to a new imbalance of 0.013999244591985843. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019819613000352104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033056086066534845, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28988888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019819613000352104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,138 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1486425747:79 , srv1998831027:79 , srv2067670115:79 , srv641971485:79 , srv1243797080:81 , srv416998357:81 , srv564194003:81 , srv542078012:82 , srv598659627:82 , srv866938317:82 , srv1104390085:83 , srv1253059703:83 , srv2070552231:83 , srv308659410:83 , srv34299926:83 , srv582942254:83 , srv619548312:83 , srv830643461:83 , srv1011911933:84 , srv133169656:84 , srv1345114039:84 , srv1345944060:84 , srv1433529593:84 , srv1559940290:84 , srv1588510896:84 , srv1640646806:84 , srv1763346478:84 , srv2111976958:84 , srv748911943:84 , srv802456893:84 , srv996041807:84 , srv1640299563:85 , srv1643531535:85 , srv1670744558:85 , srv1758056853:85 , srv1764904452:85 , srv1878111708:85 , srv2005694968:85 , srv2010445131:85 , srv2034935267:85 , srv2072615380:85 , srv2098300838:85 , srv369857077:85 , srv652799037:85 , srv756426673:85 , srv77202797:85 , srv81071029:85 , srv1083154294:86 , srv1192693072:86 , srv1453953539:86 , srv1550968179:86 , srv1963741888:86 , srv2005036969:86 , srv2124072935:86 , srv293036771:86 , srv354529898:86 , srv407105733:86 , srv694709970:86 , srv752325096:86 , srv944174752:86 , srv961141034:86 , srv1411714888:87 , srv1508698775:87 , srv1569371739:87 , srv1898748581:87 , srv1951561663:87 , srv2068209429:87 , srv36301499:87 , srv36948762:87 , srv442434980:87 , srv526516878:87 , srv572969798:87 , srv682397509:87 , srv733120541:87 , srv761647853:87 , srv867807498:87 , srv1242837006:88 , srv1246670184:88 , srv1488451071:88 , srv1507071121:88 , srv163580272:88 , srv1725010272:88 , srv1804079275:88 , srv1912547450:88 , srv2123228634:88 , srv608065466:88 , srv832385435:88 , srv891766121:88 , srv89252756:88 , srv1356094946:89 , srv1454123045:89 , srv1474714564:89 , srv1797937072:89 , srv2015813296:89 , srv1002752982:90 , srv1180692512:90 , srv1739722863:90 , srv744702499:90 , srv1424132243:91 , srv668947395:530 }
2023-03-03 11:57:02,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:02,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:02,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:02,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:02,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:02,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:02,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:02,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:02,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:02,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:02,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:02,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:02,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:02,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019819613000352104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033056086066534845, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019819613000352104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,275 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 11:57:02,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013980975983523046, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019819613000352104); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033056086066534845, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019819613000352104); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 11:57:02,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 271 ms to try 5000 different iterations.  Found a solution that moves 1021 regions; Going from a computed imbalance of 0.013980975983523046 to a new imbalance of 6.861818620380479E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008723203316114791); MoveCostFunction : (multiplier=7.0, imbalance=0.11344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,457 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1180692512:81 , srv748911943:81 , srv1002752982:83 , srv1243797080:83 , srv1246670184:83 , srv1424132243:83 , srv1643531535:83 , srv1739722863:83 , srv293036771:83 , srv442434980:83 , srv608065466:83 , srv832385435:83 , srv1083154294:84 , srv1411714888:84 , srv1507071121:84 , srv1508698775:84 , srv1963741888:84 , srv2068209429:84 , srv2098300838:84 , srv572969798:84 , srv598659627:84 , srv733120541:84 , srv744702499:84 , srv77202797:84 , srv891766121:84 , srv89252756:84 , srv1104390085:85 , srv1192693072:85 , srv1253059703:85 , srv1345944060:85 , srv1454123045:85 , srv1474714564:85 , srv1488451071:85 , srv1559940290:85 , srv1569371739:85 , srv1640646806:85 , srv1670744558:85 , srv1725010272:85 , srv1797937072:85 , srv1951561663:85 , srv1998831027:85 , srv2034935267:85 , srv2111976958:85 , srv308659410:85 , srv34299926:85 , srv36301499:85 , srv36948762:85 , srv407105733:85 , srv416998357:85 , srv619548312:85 , srv652799037:85 , srv761647853:85 , srv802456893:85 , srv867807498:85 , srv944174752:85 , srv1242837006:86 , srv1356094946:86 , srv163580272:86 , srv1764904452:86 , srv1804079275:86 , srv1878111708:86 , srv1898748581:86 , srv1912547450:86 , srv2005036969:86 , srv2010445131:86 , srv2015813296:86 , srv2067670115:86 , srv354529898:86 , srv526516878:86 , srv682397509:86 , srv752325096:86 , srv81071029:86 , srv830643461:86 , srv1011911933:87 , srv133169656:87 , srv1433529593:87 , srv1453953539:87 , srv1486425747:87 , srv1550968179:87 , srv1640299563:87 , srv1758056853:87 , srv2005694968:87 , srv2070552231:87 , srv2072615380:87 , srv2123228634:87 , srv2124072935:87 , srv369857077:87 , srv542078012:87 , srv564194003:87 , srv582942254:87 , srv641971485:87 , srv694709970:87 , srv866938317:87 , srv961141034:87 , srv996041807:87 , srv1345114039:88 , srv1588510896:88 , srv1763346478:88 , srv756426673:88 , srv668947395:553 }
2023-03-03 11:57:02,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:02,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:02,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:02,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:02,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:02,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:02,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:02,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:02,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:02,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:02,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:02,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:02,557 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008723203316114791); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,557 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 11:57:02,558 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.790326672352435E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008723203316114791); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0026666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 11:57:02,807 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 320 ms to try 5000 different iterations.  Found a solution that moves 255 regions; Going from a computed imbalance of 6.790326672352435E-4 to a new imbalance of 2.5051343171748005E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.028333333333333332, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,808 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1242837006:83 , srv1508698775:83 , srv1951561663:83 , srv407105733:83 , srv81071029:83 , srv866938317:83 , srv1180692512:84 , srv1192693072:84 , srv1243797080:84 , srv133169656:84 , srv1411714888:84 , srv1454123045:84 , srv1474714564:84 , srv1486425747:84 , srv1488451071:84 , srv1588510896:84 , srv1640299563:84 , srv1739722863:84 , srv1758056853:84 , srv1763346478:84 , srv1764904452:84 , srv1797937072:84 , srv1878111708:84 , srv1912547450:84 , srv1963741888:84 , srv2005036969:84 , srv2010445131:84 , srv2015813296:84 , srv2034935267:84 , srv2068209429:84 , srv2070552231:84 , srv2072615380:84 , srv2111976958:84 , srv2123228634:84 , srv2124072935:84 , srv308659410:84 , srv36301499:84 , srv369857077:84 , srv526516878:84 , srv542078012:84 , srv564194003:84 , srv582942254:84 , srv619548312:84 , srv641971485:84 , srv682397509:84 , srv694709970:84 , srv733120541:84 , srv756426673:84 , srv77202797:84 , srv89252756:84 , srv944174752:84 , srv961141034:84 , srv996041807:84 , srv1002752982:85 , srv1011911933:85 , srv1083154294:85 , srv1104390085:85 , srv1246670184:85 , srv1253059703:85 , srv1345114039:85 , srv1345944060:85 , srv1356094946:85 , srv1433529593:85 , srv1453953539:85 , srv1550968179:85 , srv1559940290:85 , srv1569371739:85 , srv163580272:85 , srv1640646806:85 , srv1643531535:85 , srv1725010272:85 , srv1804079275:85 , srv1898748581:85 , srv1998831027:85 , srv2005694968:85 , srv2098300838:85 , srv293036771:85 , srv34299926:85 , srv354529898:85 , srv36948762:85 , srv416998357:85 , srv572969798:85 , srv598659627:85 , srv608065466:85 , srv652799037:85 , srv744702499:85 , srv748911943:85 , srv752325096:85 , srv761647853:85 , srv802456893:85 , srv830643461:85 , srv832385435:85 , srv867807498:85 , srv891766121:85 , srv1424132243:86 , srv1507071121:86 , srv1670744558:86 , srv2067670115:86 , srv442434980:86 , srv668947395:639 }
2023-03-03 11:57:02,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:02,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:02,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:02,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:02,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:02,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:02,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:02,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:02,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:02,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:02,906 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:02,907 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 11:57:02,907 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.3265795008461876E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 11:57:03,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 251 ms to try 5000 different iterations.  Found a solution that moves 16 regions; Going from a computed imbalance of 2.3265795008461876E-5 to a new imbalance of 6.144113134287499E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0017777777777777779); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:03,088 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1104390085:83 , srv1246670184:83 , srv1569371739:83 , srv752325096:83 , srv891766121:83 , srv961141034:83 , srv1002752982:84 , srv1011911933:84 , srv1083154294:84 , srv1180692512:84 , srv1192693072:84 , srv1243797080:84 , srv1253059703:84 , srv133169656:84 , srv1345114039:84 , srv1345944060:84 , srv1356094946:84 , srv1411714888:84 , srv1424132243:84 , srv1433529593:84 , srv1453953539:84 , srv1454123045:84 , srv1474714564:84 , srv1486425747:84 , srv1488451071:84 , srv1507071121:84 , srv1550968179:84 , srv1559940290:84 , srv1588510896:84 , srv163580272:84 , srv1640299563:84 , srv1640646806:84 , srv1643531535:84 , srv1670744558:84 , srv1725010272:84 , srv1739722863:84 , srv1758056853:84 , srv1763346478:84 , srv1764904452:84 , srv1797937072:84 , srv1804079275:84 , srv1878111708:84 , srv1898748581:84 , srv1912547450:84 , srv1951561663:84 , srv1963741888:84 , srv1998831027:84 , srv2005036969:84 , srv2005694968:84 , srv2010445131:84 , srv2034935267:84 , srv2067670115:84 , srv2068209429:84 , srv2070552231:84 , srv2098300838:84 , srv2111976958:84 , srv2123228634:84 , srv2124072935:84 , srv293036771:84 , srv308659410:84 , srv34299926:84 , srv354529898:84 , srv36301499:84 , srv36948762:84 , srv369857077:84 , srv416998357:84 , srv442434980:84 , srv526516878:84 , srv542078012:84 , srv564194003:84 , srv572969798:84 , srv582942254:84 , srv598659627:84 , srv608065466:84 , srv641971485:84 , srv652799037:84 , srv682397509:84 , srv694709970:84 , srv733120541:84 , srv744702499:84 , srv748911943:84 , srv756426673:84 , srv761647853:84 , srv77202797:84 , srv802456893:84 , srv81071029:84 , srv830643461:84 , srv832385435:84 , srv866938317:84 , srv867807498:84 , srv89252756:84 , srv944174752:84 , srv996041807:84 , srv1242837006:85 , srv1508698775:85 , srv2015813296:85 , srv2072615380:85 , srv407105733:85 , srv619548312:85 , srv668947395:684 }
2023-03-03 11:57:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:03,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv733120541=82, srv163580272=28, srv652799037=78, srv1246670184=8, srv81071029=90, srv582942254=73, srv682397509=80, srv598659627=74, srv36948762=64, srv2034935267=50, srv1640299563=29, srv694709970=81, srv1763346478=36, srv1764904452=37, srv1488451071=21, srv1758056853=35, srv2124072935=58, srv1912547450=42, srv2111976958=56, srv748911943=84, srv1640646806=30, srv308659410=60, srv293036771=59, srv2005036969=46, srv2070552231=53, srv1486425747=20, srv1725010272=33, srv641971485=77, srv572969798=72, srv891766121=95, srv1083154294=2, srv2010445131=48, srv2098300838=55, srv1433529593=16, srv36301499=63, srv1550968179=24, srv526516878=69, srv2067670115=51, srv1508698775=23, srv1345944060=12, srv1507071121=22, srv1180692512=4, srv2015813296=49, srv1797937072=38, srv1951561663=43, srv1424132243=15, srv1002752982=0, srv802456893=89, srv1011911933=1, srv1588510896=27, srv407105733=66, srv867807498=94, srv1643531535=31, srv1474714564=19, srv619548312=76, srv89252756=96, srv761647853=87, srv1104390085=3, srv752325096=85, srv1559940290=25, srv1242837006=6, srv1243797080=7, srv1670744558=32, srv744702499=83, srv133169656=10, srv1253059703=9, srv608065466=75, srv2072615380=54, srv996041807=99, srv1878111708=40, srv830643461=91, srv564194003=71, srv1453953539=17, srv1569371739=26, srv1804079275=39, srv2123228634=57, srv944174752=97, srv542078012=70, srv2005694968=47, srv1454123045=18, srv1739722863=34, srv354529898=62, srv77202797=88, srv961141034=98, srv369857077=65, srv832385435=92, srv866938317=93, srv1898748581=41, srv442434980=68, srv2068209429=52, srv756426673=86, srv1192693072=5, srv416998357=67, srv1356094946=13, srv34299926=61, srv668947395=79, srv1963741888=44, srv1345114039=11, srv1411714888=14, srv1998831027=45} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:03,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:03,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 11:57:03,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 11:57:03,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 11:57:03,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 11:57:03,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 11:57:03,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 11:57:03,184 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:03,184 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1104390085:83 , srv1246670184:83 , srv1569371739:83 , srv752325096:83 , srv891766121:83 , srv961141034:83 , srv1002752982:84 , srv1011911933:84 , srv1083154294:84 , srv1180692512:84 , srv1192693072:84 , srv1243797080:84 , srv1253059703:84 , srv133169656:84 , srv1345114039:84 , srv1345944060:84 , srv1356094946:84 , srv1411714888:84 , srv1424132243:84 , srv1433529593:84 , srv1453953539:84 , srv1454123045:84 , srv1474714564:84 , srv1486425747:84 , srv1488451071:84 , srv1507071121:84 , srv1550968179:84 , srv1559940290:84 , srv1588510896:84 , srv163580272:84 , srv1640299563:84 , srv1640646806:84 , srv1643531535:84 , srv1670744558:84 , srv1725010272:84 , srv1739722863:84 , srv1758056853:84 , srv1763346478:84 , srv1764904452:84 , srv1797937072:84 , srv1804079275:84 , srv1878111708:84 , srv1898748581:84 , srv1912547450:84 , srv1951561663:84 , srv1963741888:84 , srv1998831027:84 , srv2005036969:84 , srv2005694968:84 , srv2010445131:84 , srv2034935267:84 , srv2067670115:84 , srv2068209429:84 , srv2070552231:84 , srv2098300838:84 , srv2111976958:84 , srv2123228634:84 , srv2124072935:84 , srv293036771:84 , srv308659410:84 , srv34299926:84 , srv354529898:84 , srv36301499:84 , srv36948762:84 , srv369857077:84 , srv416998357:84 , srv442434980:84 , srv526516878:84 , srv542078012:84 , srv564194003:84 , srv572969798:84 , srv582942254:84 , srv598659627:84 , srv608065466:84 , srv641971485:84 , srv652799037:84 , srv682397509:84 , srv694709970:84 , srv733120541:84 , srv744702499:84 , srv748911943:84 , srv756426673:84 , srv761647853:84 , srv77202797:84 , srv802456893:84 , srv81071029:84 , srv830643461:84 , srv832385435:84 , srv866938317:84 , srv867807498:84 , srv89252756:84 , srv944174752:84 , srv996041807:84 , srv1242837006:85 , srv1508698775:85 , srv2015813296:85 , srv2072615380:85 , srv407105733:85 , srv619548312:85 , srv668947395:684 }
2023-03-03 11:57:03,206 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 252), ProcessCount=164 (was 164), AvailableMemoryMB=9052 (was 9608)
2023-03-03 11:57:03,213 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=164, AvailableMemoryMB=9052
2023-03-03 11:57:03,214 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 11:57:03,214 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-03 11:57:03,221 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019451001:84 , srv1447368086:84 , srv1454485337:84 , srv1501333727:84 , srv1511087821:84 , srv1708298474:84 , srv1879306375:84 , srv1928569488:84 , srv1969686998:84 , srv2105243390:84 , srv213403585:84 , srv312039016:84 , srv363968377:84 , srv485847970:84 , srv487606457:84 , srv516481802:84 , srv518880308:84 , srv582459940:84 , srv585833335:84 , srv596926116:84 , srv602905227:84 , srv640589248:84 , srv674105845:84 , srv727816822:84 , srv847043650:84 , srv865703388:84 , srv865842142:84 , srv889756551:84 , srv983479142:84 , srv470057310:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-03 11:57:03,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:57:03,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv889756551=28, srv1969686998=8, srv363968377=12, srv602905227=21, srv485847970=14, srv2105243390=9, srv518880308=17, srv1708298474=5, srv516481802=16, srv596926116=20, srv983479142=29, srv582459940=18, srv674105845=23, srv1447368086=1, srv213403585=10, srv585833335=19, srv1454485337=2, srv727816822=24, srv1928569488=7, srv470057310=13, srv1879306375=6, srv640589248=22, srv847043650=25, srv865703388=26, srv1501333727=3, srv487606457=15, srv312039016=11, srv1511087821=4, srv865842142=27, srv1019451001=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:57:03,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:57:03,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 11:57:03,253 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1262483397483254, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:57:03,254 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912590847660439, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1262483397483254, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-03 11:59:03,236 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9255330 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912590847660439 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:59:03,241 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1019451001:90 , srv1447368086:90 , srv1454485337:90 , srv1501333727:90 , srv1511087821:90 , srv1708298474:90 , srv1879306375:90 , srv1928569488:90 , srv1969686998:90 , srv2105243390:90 , srv213403585:90 , srv312039016:90 , srv363968377:90 , srv470057310:90 , srv485847970:90 , srv487606457:90 , srv516481802:90 , srv518880308:90 , srv582459940:90 , srv585833335:90 , srv596926116:90 , srv602905227:90 , srv640589248:90 , srv674105845:90 , srv727816822:90 , srv847043650:90 , srv865703388:90 , srv865842142:90 , srv889756551:90 , srv983479142:90 }
2023-03-03 11:59:03,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 11:59:03,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv889756551=28, srv1969686998=8, srv363968377=12, srv602905227=21, srv485847970=14, srv2105243390=9, srv518880308=17, srv1708298474=5, srv516481802=16, srv596926116=20, srv983479142=29, srv582459940=18, srv674105845=23, srv1447368086=1, srv213403585=10, srv585833335=19, srv1454485337=2, srv727816822=24, srv1928569488=7, srv470057310=13, srv1879306375=6, srv640589248=22, srv847043650=25, srv865703388=26, srv1501333727=3, srv487606457=15, srv312039016=11, srv1511087821=4, srv865842142=27, srv1019451001=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 11:59:03,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 11:59:03,246 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 11:59:03,247 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 11:59:03,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 11:59:03,256 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1019451001:90 , srv1447368086:90 , srv1454485337:90 , srv1501333727:90 , srv1511087821:90 , srv1708298474:90 , srv1879306375:90 , srv1928569488:90 , srv1969686998:90 , srv2105243390:90 , srv213403585:90 , srv312039016:90 , srv363968377:90 , srv470057310:90 , srv485847970:90 , srv487606457:90 , srv516481802:90 , srv518880308:90 , srv582459940:90 , srv585833335:90 , srv596926116:90 , srv602905227:90 , srv640589248:90 , srv674105845:90 , srv727816822:90 , srv847043650:90 , srv865703388:90 , srv865842142:90 , srv889756551:90 , srv983479142:90 }
2023-03-03 11:59:03,267 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 252), ProcessCount=165 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=9106 (was 9052) - AvailableMemoryMB LEAK? -