2023-09-25 18:53:16,333 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-25 18:53:16,664 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-25 18:53:16,785 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-25 18:53:16,855 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 18:53:16,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 18:53:16,876 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=169, AvailableMemoryMB=8690
2023-09-25 18:53:16,878 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 18:53:16,878 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-25 18:53:17,027 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1038699524:84 , srv1067189074:84 , srv1093259731:84 , srv1094260833:84 , srv1105137944:84 , srv1136485974:84 , srv1159173853:84 , srv118161011:84 , srv1184567990:84 , srv1197004687:84 , srv120469192:84 , srv1211378864:84 , srv1225733843:84 , srv1234464941:84 , srv1271043838:84 , srv1276036938:84 , srv128269463:84 , srv1291286694:84 , srv1308406234:84 , srv1318132787:84 , srv1321401539:84 , srv1371021625:84 , srv1374555422:84 , srv1432987296:84 , srv1434336306:84 , srv1451805936:84 , srv1505284188:84 , srv1523096735:84 , srv1552356014:84 , srv155920393:84 , srv1563048056:84 , srv1608034494:84 , srv1640556710:84 , srv1643042141:84 , srv1657028135:84 , srv1665712021:84 , srv166748363:84 , srv1673663394:84 , srv1690312800:84 , srv1722322121:84 , srv1735646005:84 , srv1770697664:84 , srv1783600844:84 , srv1850271829:84 , srv1869161635:84 , srv1872684082:84 , srv1897416971:84 , srv1915975841:84 , srv1924621634:84 , srv1947810896:84 , srv1963056649:84 , srv1993339811:84 , srv1993384149:84 , srv2011782506:84 , srv2013453995:84 , srv205119599:84 , srv2056180899:84 , srv206439878:84 , srv2125834455:84 , srv2141901903:84 , srv226588035:84 , srv228676476:84 , srv233904871:84 , srv235135977:84 , srv241819114:84 , srv243954726:84 , srv244050057:84 , srv263050281:84 , srv300535250:84 , srv342653464:84 , srv372603809:84 , srv388749596:84 , srv389136551:84 , srv393410238:84 , srv433279925:84 , srv469762025:84 , srv492550186:84 , srv50729347:84 , srv591684152:84 , srv626595375:84 , srv653443415:84 , srv667866118:84 , srv675969223:84 , srv690164196:84 , srv734616834:84 , srv737650779:84 , srv814355368:84 , srv845077524:84 , srv845389467:84 , srv866160933:84 , srv88011130:84 , srv880290892:84 , srv91004697:84 , srv934033815:84 , srv95136622:84 , srv95923714:84 , srv961841011:84 , srv962018194:84 , srv989770872:84 , srv1776334394:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-25 18:53:17,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:17,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:17,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:17,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:17,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:17,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:17,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:17,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:17,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:17,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:17,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:17,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:17,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:17,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:17,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:17,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:17,137 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:17,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:17,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:17,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:17,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:17,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:17,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:17,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:17,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:17,497 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 18:53:17,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 18:53:17,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 624 ms to try 5000 different iterations.  Found a solution that moves 4687 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17656880065573122. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016240878839, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05686734124751364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5207777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016240878839, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:17,834 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1963056649:80 , srv1197004687:81 , srv1184567990:82 , srv1374555422:82 , srv1451805936:82 , srv1640556710:82 , srv1665712021:82 , srv1770697664:82 , srv690164196:82 , srv128269463:83 , srv1308406234:83 , srv389136551:83 , srv50729347:83 , srv989770872:83 , srv1434336306:84 , srv433279925:84 , srv492550186:84 , srv734616834:84 , srv95136622:84 , srv1105137944:85 , srv1432987296:85 , srv166748363:85 , srv1722322121:85 , srv1850271829:85 , srv1924621634:85 , srv1993339811:85 , srv235135977:85 , srv244050057:85 , srv342653464:85 , srv388749596:85 , srv95923714:85 , srv1038699524:86 , srv1094260833:86 , srv1234464941:86 , srv1271043838:86 , srv1291286694:86 , srv1318132787:86 , srv1505284188:86 , srv1552356014:86 , srv1608034494:86 , srv1690312800:86 , srv1735646005:86 , srv1783600844:86 , srv1915975841:86 , srv2011782506:86 , srv2056180899:86 , srv2125834455:86 , srv243954726:86 , srv372603809:86 , srv653443415:86 , srv675969223:86 , srv814355368:86 , srv880290892:86 , srv1067189074:87 , srv1159173853:87 , srv1211378864:87 , srv155920393:87 , srv1563048056:87 , srv1643042141:87 , srv1673663394:87 , srv1993384149:87 , srv233904871:87 , srv263050281:87 , srv300535250:87 , srv393410238:87 , srv626595375:87 , srv866160933:87 , srv88011130:87 , srv961841011:87 , srv120469192:88 , srv1225733843:88 , srv1321401539:88 , srv1657028135:88 , srv1869161635:88 , srv2013453995:88 , srv206439878:88 , srv2141901903:88 , srv962018194:88 , srv118161011:89 , srv228676476:89 , srv469762025:89 , srv591684152:89 , srv737650779:89 , srv845077524:89 , srv934033815:89 , srv1093259731:90 , srv1276036938:90 , srv1371021625:90 , srv1523096735:90 , srv1872684082:90 , srv1897416971:90 , srv1947810896:90 , srv205119599:90 , srv226588035:90 , srv241819114:90 , srv91004697:90 , srv1136485974:91 , srv845389467:91 , srv667866118:92 , srv1776334394:447 }
2023-09-25 18:53:17,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:17,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:17,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:17,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:17,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:17,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:17,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:17,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:17,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:17,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:17,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:17,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:17,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:17,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:17,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:18,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016240878839, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05686734124751364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016240878839, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:18,082 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 18:53:18,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1765359815802751, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04016240878839, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05686734124751364, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04016240878839, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17141666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 18:53:18,414 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 497 ms to try 5000 different iterations.  Found a solution that moves 2669 regions; Going from a computed imbalance of 0.1765359815802751 to a new imbalance of 0.015389583284820218. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02160708663360516); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02991945791354898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29655555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02160708663360516); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:18,428 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv667866118:79 , srv1371021625:80 , srv1136485974:81 , srv1225733843:81 , srv1276036938:81 , srv1523096735:81 , srv226588035:81 , srv845389467:81 , srv1897416971:82 , srv205119599:82 , srv228676476:82 , srv241819114:82 , srv91004697:82 , srv934033815:82 , srv1093259731:83 , srv1643042141:83 , srv1657028135:83 , srv1947810896:83 , srv1159173853:84 , srv118161011:84 , srv1552356014:84 , srv1563048056:84 , srv1690312800:84 , srv1783600844:84 , srv1872684082:84 , srv2013453995:84 , srv206439878:84 , srv2141901903:84 , srv243954726:84 , srv300535250:84 , srv393410238:84 , srv469762025:84 , srv737650779:84 , srv845077524:84 , srv961841011:84 , srv962018194:84 , srv1038699524:85 , srv1094260833:85 , srv120469192:85 , srv1211378864:85 , srv1318132787:85 , srv1505284188:85 , srv1869161635:85 , srv1924621634:85 , srv1993339811:85 , srv244050057:85 , srv591684152:85 , srv675969223:85 , srv866160933:85 , srv1321401539:86 , srv1735646005:86 , srv1850271829:86 , srv1993384149:86 , srv2011782506:86 , srv263050281:86 , srv342653464:86 , srv653443415:86 , srv734616834:86 , srv814355368:86 , srv88011130:86 , srv880290892:86 , srv1067189074:87 , srv1234464941:87 , srv1291286694:87 , srv1608034494:87 , srv166748363:87 , srv1673663394:87 , srv1722322121:87 , srv1915975841:87 , srv2056180899:87 , srv233904871:87 , srv389136551:87 , srv95923714:87 , srv989770872:87 , srv1271043838:88 , srv1432987296:88 , srv1434336306:88 , srv155920393:88 , srv1640556710:88 , srv235135977:88 , srv372603809:88 , srv433279925:88 , srv492550186:88 , srv626595375:88 , srv1105137944:89 , srv128269463:89 , srv1308406234:89 , srv1374555422:89 , srv690164196:89 , srv95136622:89 , srv1184567990:90 , srv1197004687:90 , srv1451805936:90 , srv388749596:90 , srv50729347:90 , srv1770697664:91 , srv2125834455:91 , srv1665712021:93 , srv1963056649:93 , srv1776334394:519 }
2023-09-25 18:53:18,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:18,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:18,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:18,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:18,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:18,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:18,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:18,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:18,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:18,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:18,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:18,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:18,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:18,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:18,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02160708663360516); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02991945791354898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02160708663360516); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:18,762 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 18:53:18,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015370894547377825, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02160708663360516); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02991945791354898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02160708663360516); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04808333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 18:53:19,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 626 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.015370894547377825 to a new imbalance of 4.8069977497462935E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005796137625435506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005645732772720049); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005796137625435506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:19,146 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv155920393:81 , srv2125834455:81 , srv1067189074:83 , srv1105137944:83 , srv1665712021:83 , srv1673663394:83 , srv1770697664:83 , srv2056180899:83 , srv372603809:83 , srv388749596:83 , srv469762025:83 , srv626595375:83 , srv118161011:84 , srv1271043838:84 , srv1308406234:84 , srv1321401539:84 , srv1869161635:84 , srv1947810896:84 , srv1963056649:84 , srv205119599:84 , srv233904871:84 , srv591684152:84 , srv1093259731:85 , srv1184567990:85 , srv120469192:85 , srv1291286694:85 , srv1432987296:85 , srv1434336306:85 , srv1451805936:85 , srv1722322121:85 , srv1735646005:85 , srv1872684082:85 , srv1915975841:85 , srv2011782506:85 , srv2013453995:85 , srv206439878:85 , srv2141901903:85 , srv235135977:85 , srv393410238:85 , srv433279925:85 , srv492550186:85 , srv737650779:85 , srv845077524:85 , srv845389467:85 , srv866160933:85 , srv88011130:85 , srv880290892:85 , srv95136622:85 , srv95923714:85 , srv962018194:85 , srv1038699524:86 , srv1094260833:86 , srv1136485974:86 , srv1159173853:86 , srv1197004687:86 , srv1211378864:86 , srv128269463:86 , srv1374555422:86 , srv1563048056:86 , srv1608034494:86 , srv1657028135:86 , srv166748363:86 , srv1850271829:86 , srv1897416971:86 , srv1993339811:86 , srv1993384149:86 , srv241819114:86 , srv50729347:86 , srv653443415:86 , srv667866118:86 , srv675969223:86 , srv690164196:86 , srv814355368:86 , srv934033815:86 , srv1234464941:87 , srv1318132787:87 , srv1371021625:87 , srv1505284188:87 , srv1523096735:87 , srv1552356014:87 , srv1640556710:87 , srv1643042141:87 , srv1690312800:87 , srv1924621634:87 , srv226588035:87 , srv228676476:87 , srv263050281:87 , srv300535250:87 , srv342653464:87 , srv389136551:87 , srv734616834:87 , srv91004697:87 , srv961841011:87 , srv989770872:87 , srv1225733843:88 , srv1276036938:88 , srv1783600844:88 , srv244050057:88 , srv243954726:89 , srv1776334394:543 }
2023-09-25 18:53:19,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:19,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:19,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:19,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:19,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:19,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:19,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:19,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:19,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:19,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:19,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:19,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:19,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:19,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:19,351 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005796137625435506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005645732772720049); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005796137625435506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:19,351 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 18:53:19,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.734595522262456E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005796137625435506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005645732772720049); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005796137625435506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003833333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 18:53:19,605 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 388 ms to try 5000 different iterations.  Found a solution that moves 206 regions; Going from a computed imbalance of 4.734595522262456E-4 to a new imbalance of 2.5221152323116646E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.02288888888888889); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:19,606 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1234464941:82 , srv263050281:82 , srv1276036938:83 , srv1505284188:83 , srv1608034494:83 , srv1872684082:83 , srv1993384149:83 , srv243954726:83 , srv50729347:83 , srv91004697:83 , srv1093259731:84 , srv1136485974:84 , srv1159173853:84 , srv120469192:84 , srv1211378864:84 , srv1225733843:84 , srv1271043838:84 , srv128269463:84 , srv1291286694:84 , srv1318132787:84 , srv1321401539:84 , srv1432987296:84 , srv1523096735:84 , srv166748363:84 , srv1690312800:84 , srv1783600844:84 , srv1869161635:84 , srv1897416971:84 , srv1915975841:84 , srv2125834455:84 , srv226588035:84 , srv228676476:84 , srv233904871:84 , srv235135977:84 , srv241819114:84 , srv300535250:84 , srv342653464:84 , srv388749596:84 , srv591684152:84 , srv626595375:84 , srv653443415:84 , srv737650779:84 , srv814355368:84 , srv845077524:84 , srv88011130:84 , srv95136622:84 , srv961841011:84 , srv1038699524:85 , srv1067189074:85 , srv1094260833:85 , srv1105137944:85 , srv118161011:85 , srv1184567990:85 , srv1197004687:85 , srv1371021625:85 , srv1374555422:85 , srv1434336306:85 , srv1451805936:85 , srv1552356014:85 , srv1563048056:85 , srv1640556710:85 , srv1643042141:85 , srv1657028135:85 , srv1665712021:85 , srv1673663394:85 , srv1722322121:85 , srv1735646005:85 , srv1850271829:85 , srv1924621634:85 , srv1947810896:85 , srv1963056649:85 , srv2011782506:85 , srv206439878:85 , srv2141901903:85 , srv244050057:85 , srv372603809:85 , srv389136551:85 , srv433279925:85 , srv492550186:85 , srv667866118:85 , srv675969223:85 , srv690164196:85 , srv734616834:85 , srv866160933:85 , srv880290892:85 , srv934033815:85 , srv95923714:85 , srv962018194:85 , srv989770872:85 , srv1308406234:86 , srv155920393:86 , srv1770697664:86 , srv1993339811:86 , srv2013453995:86 , srv205119599:86 , srv2056180899:86 , srv393410238:86 , srv469762025:86 , srv845389467:86 , srv1776334394:634 }
2023-09-25 18:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:19,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:19,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:19,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:19,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:19,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:19,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:19,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:19,730 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:19,730 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-25 18:53:19,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.377870949316785E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.5313429231318235E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.5313429231318235E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-25 18:53:19,944 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 309 ms to try 5000 different iterations.  Found a solution that moves 9 regions; Going from a computed imbalance of 2.377870949316785E-5 to a new imbalance of 7.450776847252069E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.001); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:19,944 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1665712021:83 , srv2013453995:83 , srv244050057:83 , srv845389467:83 , srv1038699524:84 , srv1067189074:84 , srv1093259731:84 , srv1094260833:84 , srv1105137944:84 , srv1136485974:84 , srv118161011:84 , srv1184567990:84 , srv1197004687:84 , srv120469192:84 , srv1211378864:84 , srv1234464941:84 , srv1271043838:84 , srv1276036938:84 , srv128269463:84 , srv1291286694:84 , srv1308406234:84 , srv1318132787:84 , srv1321401539:84 , srv1371021625:84 , srv1374555422:84 , srv1432987296:84 , srv1434336306:84 , srv1451805936:84 , srv1523096735:84 , srv1552356014:84 , srv155920393:84 , srv1563048056:84 , srv1608034494:84 , srv1640556710:84 , srv1643042141:84 , srv1657028135:84 , srv166748363:84 , srv1673663394:84 , srv1722322121:84 , srv1735646005:84 , srv1770697664:84 , srv1783600844:84 , srv1850271829:84 , srv1872684082:84 , srv1897416971:84 , srv1915975841:84 , srv1924621634:84 , srv1947810896:84 , srv1963056649:84 , srv1993339811:84 , srv1993384149:84 , srv2011782506:84 , srv205119599:84 , srv2056180899:84 , srv206439878:84 , srv2125834455:84 , srv2141901903:84 , srv226588035:84 , srv228676476:84 , srv233904871:84 , srv235135977:84 , srv241819114:84 , srv243954726:84 , srv263050281:84 , srv300535250:84 , srv342653464:84 , srv372603809:84 , srv388749596:84 , srv389136551:84 , srv393410238:84 , srv433279925:84 , srv469762025:84 , srv492550186:84 , srv50729347:84 , srv591684152:84 , srv626595375:84 , srv653443415:84 , srv667866118:84 , srv675969223:84 , srv690164196:84 , srv734616834:84 , srv737650779:84 , srv814355368:84 , srv845077524:84 , srv866160933:84 , srv88011130:84 , srv880290892:84 , srv91004697:84 , srv934033815:84 , srv95136622:84 , srv95923714:84 , srv961841011:84 , srv962018194:84 , srv989770872:84 , srv1159173853:85 , srv1225733843:85 , srv1505284188:85 , srv1690312800:85 , srv1869161635:85 , srv1776334394:683 }
2023-09-25 18:53:19,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:19,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv120469192=10, srv1234464941=13, srv1291286694=17, srv469762025=76, srv1869161635=45, srv653443415=81, srv814355368=87, srv1665712021=35, srv690164196=84, srv989770872=99, srv1657028135=34, srv388749596=72, srv1640556710=32, srv1872684082=46, srv626595375=80, srv1673663394=37, srv492550186=77, srv1563048056=30, srv1093259731=2, srv389136551=73, srv1776334394=42, srv433279925=75, srv1434336306=24, srv1067189074=1, srv263050281=68, srv393410238=74, srv1197004687=9, srv737650779=86, srv1993384149=53, srv228676476=62, srv1993339811=52, srv1924621634=49, srv235135977=64, srv155920393=29, srv1105137944=4, srv1094260833=3, srv2141901903=60, srv166748363=36, srv734616834=85, srv1897416971=47, srv1271043838=14, srv2013453995=55, srv675969223=83, srv128269463=16, srv1318132787=19, srv300535250=69, srv880290892=92, srv1276036938=15, srv1947810896=50, srv95136622=95, srv1038699524=0, srv1783600844=43, srv1770697664=41, srv244050057=67, srv241819114=65, srv1850271829=44, srv205119599=56, srv1371021625=21, srv118161011=7, srv866160933=90, srv1374555422=22, srv1136485974=5, srv2056180899=57, srv934033815=94, srv1451805936=25, srv1690312800=38, srv206439878=58, srv50729347=78, srv88011130=91, srv1211378864=11, srv2011782506=54, srv243954726=66, srv1159173853=6, srv372603809=71, srv342653464=70, srv667866118=82, srv1608034494=31, srv1321401539=20, srv1552356014=28, srv1643042141=33, srv1722322121=39, srv1432987296=23, srv1523096735=27, srv1963056649=51, srv1915975841=48, srv226588035=61, srv95923714=96, srv961841011=97, srv1308406234=18, srv962018194=98, srv1505284188=26, srv845077524=88, srv591684152=79, srv233904871=63, srv1225733843=12, srv845389467=89, srv1735646005=40, srv2125834455=59, srv91004697=93, srv1184567990=8} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:19,960 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-25 18:53:19,961 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-25 18:53:19,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-25 18:53:19,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-25 18:53:19,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-25 18:53:20,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.387757500312559E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:20,066 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1665712021:83 , srv2013453995:83 , srv244050057:83 , srv845389467:83 , srv1038699524:84 , srv1067189074:84 , srv1093259731:84 , srv1094260833:84 , srv1105137944:84 , srv1136485974:84 , srv118161011:84 , srv1184567990:84 , srv1197004687:84 , srv120469192:84 , srv1211378864:84 , srv1234464941:84 , srv1271043838:84 , srv1276036938:84 , srv128269463:84 , srv1291286694:84 , srv1308406234:84 , srv1318132787:84 , srv1321401539:84 , srv1371021625:84 , srv1374555422:84 , srv1432987296:84 , srv1434336306:84 , srv1451805936:84 , srv1523096735:84 , srv1552356014:84 , srv155920393:84 , srv1563048056:84 , srv1608034494:84 , srv1640556710:84 , srv1643042141:84 , srv1657028135:84 , srv166748363:84 , srv1673663394:84 , srv1722322121:84 , srv1735646005:84 , srv1770697664:84 , srv1783600844:84 , srv1850271829:84 , srv1872684082:84 , srv1897416971:84 , srv1915975841:84 , srv1924621634:84 , srv1947810896:84 , srv1963056649:84 , srv1993339811:84 , srv1993384149:84 , srv2011782506:84 , srv205119599:84 , srv2056180899:84 , srv206439878:84 , srv2125834455:84 , srv2141901903:84 , srv226588035:84 , srv228676476:84 , srv233904871:84 , srv235135977:84 , srv241819114:84 , srv243954726:84 , srv263050281:84 , srv300535250:84 , srv342653464:84 , srv372603809:84 , srv388749596:84 , srv389136551:84 , srv393410238:84 , srv433279925:84 , srv469762025:84 , srv492550186:84 , srv50729347:84 , srv591684152:84 , srv626595375:84 , srv653443415:84 , srv667866118:84 , srv675969223:84 , srv690164196:84 , srv734616834:84 , srv737650779:84 , srv814355368:84 , srv845077524:84 , srv866160933:84 , srv88011130:84 , srv880290892:84 , srv91004697:84 , srv934033815:84 , srv95136622:84 , srv95923714:84 , srv961841011:84 , srv962018194:84 , srv989770872:84 , srv1159173853:85 , srv1225733843:85 , srv1505284188:85 , srv1690312800:85 , srv1869161635:85 , srv1776334394:683 }
2023-09-25 18:53:20,090 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 283) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=8055 (was 8690)
2023-09-25 18:53:20,099 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=169, AvailableMemoryMB=8054
2023-09-25 18:53:20,099 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-25 18:53:20,100 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-25 18:53:20,111 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013084867:84 , srv1024342516:84 , srv112176544:84 , srv1239780465:84 , srv1261537606:84 , srv1376697646:84 , srv1565361285:84 , srv1572582101:84 , srv1628483446:84 , srv1785139099:84 , srv1813659593:84 , srv1863377232:84 , srv1986559718:84 , srv2014996897:84 , srv2036610135:84 , srv217490590:84 , srv304246662:84 , srv306869619:84 , srv359074401:84 , srv435989086:84 , srv451596162:84 , srv495330988:84 , srv524799280:84 , srv533094436:84 , srv636315461:84 , srv710456113:84 , srv725237752:84 , srv796883948:84 , srv947721239:84 , srv379040541:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-25 18:53:20,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:53:20,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv217490590=15, srv359074401=18, srv796883948=28, srv112176544=2, srv1565361285=6, srv1572582101=7, srv1239780465=3, srv524799280=23, srv1013084867=0, srv451596162=21, srv1863377232=11, srv636315461=25, srv2036610135=14, srv1024342516=1, srv533094436=24, srv1785139099=9, srv379040541=19, srv947721239=29, srv306869619=17, srv1628483446=8, srv710456113=26, srv435989086=20, srv1261537606=4, srv725237752=27, srv1986559718=12, srv2014996897=13, srv304246662=16, srv1376697646=5, srv495330988=22, srv1813659593=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:53:20,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:53:20,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 18:53:20,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0518738009021535, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:53:20,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912356495917088, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0518738009021535, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-25 18:55:20,125 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6184900 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912356495917088 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:55:20,133 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013084867:90 , srv1024342516:90 , srv112176544:90 , srv1239780465:90 , srv1261537606:90 , srv1376697646:90 , srv1565361285:90 , srv1572582101:90 , srv1628483446:90 , srv1785139099:90 , srv1813659593:90 , srv1863377232:90 , srv1986559718:90 , srv2014996897:90 , srv2036610135:90 , srv217490590:90 , srv304246662:90 , srv306869619:90 , srv359074401:90 , srv379040541:90 , srv435989086:90 , srv451596162:90 , srv495330988:90 , srv524799280:90 , srv533094436:90 , srv636315461:90 , srv710456113:90 , srv725237752:90 , srv796883948:90 , srv947721239:90 }
2023-09-25 18:55:20,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-25 18:55:20,135 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv217490590=15, srv359074401=18, srv796883948=28, srv112176544=2, srv1565361285=6, srv1572582101=7, srv1239780465=3, srv524799280=23, srv1013084867=0, srv451596162=21, srv1863377232=11, srv636315461=25, srv2036610135=14, srv1024342516=1, srv533094436=24, srv1785139099=9, srv379040541=19, srv947721239=29, srv306869619=17, srv1628483446=8, srv710456113=26, srv435989086=20, srv1261537606=4, srv725237752=27, srv1986559718=12, srv2014996897=13, srv304246662=16, srv1376697646=5, srv495330988=22, srv1813659593=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-25 18:55:20,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-25 18:55:20,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-25 18:55:20,159 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-25 18:55:20,159 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013084867:90 , srv1024342516:90 , srv112176544:90 , srv1239780465:90 , srv1261537606:90 , srv1376697646:90 , srv1565361285:90 , srv1572582101:90 , srv1628483446:90 , srv1785139099:90 , srv1813659593:90 , srv1863377232:90 , srv1986559718:90 , srv2014996897:90 , srv2036610135:90 , srv217490590:90 , srv304246662:90 , srv306869619:90 , srv359074401:90 , srv379040541:90 , srv435989086:90 , srv451596162:90 , srv495330988:90 , srv524799280:90 , srv533094436:90 , srv636315461:90 , srv710456113:90 , srv725237752:90 , srv796883948:90 , srv947721239:90 }
2023-09-25 18:55:20,174 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 308), ProcessCount=170 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=6875 (was 8054)