2023-07-20 20:52:46,462 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-20 20:52:46,764 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-20 20:52:46,866 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-20 20:52:46,929 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-20 20:52:46,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-20 20:52:46,950 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=171, AvailableMemoryMB=10667
2023-07-20 20:52:46,952 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-20 20:52:46,952 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-20 20:52:47,081 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1018079355:84 , srv1032963095:84 , srv1050871371:84 , srv1076281879:84 , srv1089873953:84 , srv1103815788:84 , srv1104713605:84 , srv1116841667:84 , srv1124883447:84 , srv1197192641:84 , srv1244514573:84 , srv1257434036:84 , srv127390994:84 , srv1304801295:84 , srv1337198986:84 , srv1353890276:84 , srv1354388346:84 , srv1390288078:84 , srv1394558306:84 , srv1399306975:84 , srv1405159590:84 , srv1411044580:84 , srv1421938160:84 , srv1427092702:84 , srv143443824:84 , srv1446952332:84 , srv1476109769:84 , srv1481198833:84 , srv1485679487:84 , srv1493540499:84 , srv1503394050:84 , srv1510640042:84 , srv1513544900:84 , srv1526169573:84 , srv1542356669:84 , srv1567734747:84 , srv1601724265:84 , srv1609076420:84 , srv1670942162:84 , srv1680204811:84 , srv1688184030:84 , srv1692052425:84 , srv1742305819:84 , srv1766700540:84 , srv1786528138:84 , srv180400214:84 , srv1817643641:84 , srv1861953802:84 , srv1865023337:84 , srv1955304191:84 , srv196329438:84 , srv198156813:84 , srv1999418448:84 , srv2017162508:84 , srv2045443507:84 , srv205984227:84 , srv2070100477:84 , srv2082331713:84 , srv2083548719:84 , srv237765822:84 , srv24748753:84 , srv262526491:84 , srv273980516:84 , srv274996080:84 , srv300770684:84 , srv326423711:84 , srv338917817:84 , srv353095060:84 , srv361334026:84 , srv365350721:84 , srv379348924:84 , srv382936917:84 , srv387447712:84 , srv392432085:84 , srv450773753:84 , srv495516808:84 , srv497842337:84 , srv526885625:84 , srv529405892:84 , srv563916179:84 , srv574163393:84 , srv589211692:84 , srv62337671:84 , srv643968592:84 , srv648896352:84 , srv660742938:84 , srv667397894:84 , srv696819456:84 , srv69733682:84 , srv703181122:84 , srv817129747:84 , srv827448087:84 , srv848818032:84 , srv855786483:84 , srv87019983:84 , srv965214261:84 , srv965507646:84 , srv967295465:84 , srv985537654:84 , srv1058978460:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-20 20:52:47,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:47,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:47,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:47,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:47,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:47,179 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:47,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:47,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:47,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:47,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:47,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:47,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:47,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:47,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:47,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:47,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:47,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:47,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:47,535 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:47,535 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-20 20:52:47,535 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-20 20:52:48,077 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 867 ms to try 5000 different iterations.  Found a solution that moves 4661 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18060205068680185. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04129104917518782, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05170276788054523, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5178888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04129104917518782, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,087 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1510640042:81 , srv205984227:81 , srv1018079355:82 , srv1197192641:82 , srv1526169573:82 , srv1955304191:82 , srv2070100477:82 , srv237765822:82 , srv1076281879:83 , srv1116841667:83 , srv1353890276:83 , srv1394558306:83 , srv1688184030:83 , srv563916179:83 , srv967295465:83 , srv1032963095:84 , srv1476109769:84 , srv198156813:84 , srv2017162508:84 , srv274996080:84 , srv326423711:84 , srv382936917:84 , srv855786483:84 , srv1104713605:85 , srv1421938160:85 , srv1481198833:85 , srv1609076420:85 , srv1766700540:85 , srv1817643641:85 , srv2083548719:85 , srv526885625:85 , srv574163393:85 , srv69733682:85 , srv848818032:85 , srv965507646:85 , srv1050871371:86 , srv1089873953:86 , srv1103815788:86 , srv127390994:86 , srv1337198986:86 , srv1390288078:86 , srv1399306975:86 , srv1427092702:86 , srv143443824:86 , srv1446952332:86 , srv1786528138:86 , srv1865023337:86 , srv24748753:86 , srv300770684:86 , srv353095060:86 , srv379348924:86 , srv495516808:86 , srv497842337:86 , srv817129747:86 , srv827448087:86 , srv1257434036:87 , srv1485679487:87 , srv1493540499:87 , srv1503394050:87 , srv1601724265:87 , srv1670942162:87 , srv1680204811:87 , srv1861953802:87 , srv2045443507:87 , srv273980516:87 , srv338917817:87 , srv361334026:87 , srv392432085:87 , srv589211692:87 , srv62337671:87 , srv703181122:87 , srv87019983:87 , srv965214261:87 , srv1304801295:88 , srv1411044580:88 , srv1513544900:88 , srv1692052425:88 , srv1742305819:88 , srv365350721:88 , srv643968592:88 , srv660742938:88 , srv696819456:88 , srv1244514573:89 , srv262526491:89 , srv387447712:89 , srv450773753:89 , srv529405892:89 , srv1354388346:90 , srv1405159590:90 , srv1542356669:90 , srv196329438:90 , srv1999418448:90 , srv1124883447:91 , srv1567734747:91 , srv2082331713:91 , srv648896352:91 , srv180400214:93 , srv667397894:93 , srv985537654:93 , srv1058978460:457 }
2023-07-20 20:52:48,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:48,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:48,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:48,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:48,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:48,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:48,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:48,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:48,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:48,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:48,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:48,222 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04129104917518782, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05170276788054523, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04129104917518782, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,222 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-20 20:52:48,222 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18056941366723683, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04129104917518782, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05170276788054523, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04129104917518782, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1765, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23591666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-20 20:52:48,424 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 293 ms to try 5000 different iterations.  Found a solution that moves 2627 regions; Going from a computed imbalance of 0.18056941366723683 to a new imbalance of 0.01438660127898864. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020919742240605957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031237118557216118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29188888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020919742240605957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,433 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv180400214:80 , srv1999418448:80 , srv985537654:80 , srv1405159590:81 , srv1542356669:81 , srv1567734747:81 , srv667397894:81 , srv648896352:82 , srv1124883447:83 , srv1244514573:83 , srv1304801295:83 , srv1692052425:83 , srv365350721:83 , srv387447712:83 , srv450773753:83 , srv643968592:83 , srv1411044580:84 , srv1493540499:84 , srv1513544900:84 , srv1742305819:84 , srv1861953802:84 , srv1865023337:84 , srv196329438:84 , srv2045443507:84 , srv2082331713:84 , srv338917817:84 , srv660742938:84 , srv1089873953:85 , srv1354388346:85 , srv1399306975:85 , srv1427092702:85 , srv1503394050:85 , srv1680204811:85 , srv1786528138:85 , srv262526491:85 , srv273980516:85 , srv361334026:85 , srv392432085:85 , srv497842337:85 , srv526885625:85 , srv529405892:85 , srv696819456:85 , srv703181122:85 , srv87019983:85 , srv965214261:85 , srv1104713605:86 , srv127390994:86 , srv1421938160:86 , srv1446952332:86 , srv1481198833:86 , srv1485679487:86 , srv1601724265:86 , srv1670942162:86 , srv1817643641:86 , srv2083548719:86 , srv300770684:86 , srv379348924:86 , srv495516808:86 , srv589211692:86 , srv62337671:86 , srv817129747:86 , srv827448087:86 , srv965507646:86 , srv1050871371:87 , srv1103815788:87 , srv1257434036:87 , srv1337198986:87 , srv1353890276:87 , srv198156813:87 , srv2017162508:87 , srv24748753:87 , srv326423711:87 , srv353095060:87 , srv382936917:87 , srv574163393:87 , srv69733682:87 , srv848818032:87 , srv1390288078:88 , srv1609076420:88 , srv1766700540:88 , srv274996080:88 , srv563916179:88 , srv855786483:88 , srv967295465:88 , srv1032963095:89 , srv1076281879:89 , srv1197192641:89 , srv143443824:89 , srv1688184030:89 , srv1018079355:90 , srv1116841667:90 , srv1510640042:90 , srv1955304191:90 , srv205984227:90 , srv2070100477:90 , srv1394558306:91 , srv1526169573:91 , srv237765822:91 , srv1476109769:93 , srv1058978460:503 }
2023-07-20 20:52:48,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:48,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:48,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:48,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:48,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:48,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:48,459 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:48,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:48,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:48,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:48,463 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:48,551 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020919742240605957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031237118557216118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020919742240605957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,552 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-20 20:52:48,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014368206631831963, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020919742240605957); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031237118557216118, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020919742240605957); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-20 20:52:48,775 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 300 ms to try 5000 different iterations.  Found a solution that moves 958 regions; Going from a computed imbalance of 0.014368206631831963 to a new imbalance of 0.0011373311116383649. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0058900428744598655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009870087677015036); MoveCostFunction : (multiplier=7.0, imbalance=0.10644444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0058900428744598655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,776 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1476109769:81 , srv1354388346:82 , srv1394558306:82 , srv143443824:82 , srv1032963095:83 , srv1257434036:83 , srv529405892:83 , srv1116841667:84 , srv1124883447:84 , srv1337198986:84 , srv1390288078:84 , srv1485679487:84 , srv1526169573:84 , srv1670942162:84 , srv1742305819:84 , srv1766700540:84 , srv2082331713:84 , srv262526491:84 , srv379348924:84 , srv450773753:84 , srv62337671:84 , srv667397894:84 , srv848818032:84 , srv1018079355:85 , srv1050871371:85 , srv1076281879:85 , srv1103815788:85 , srv127390994:85 , srv1304801295:85 , srv1503394050:85 , srv1513544900:85 , srv1601724265:85 , srv1609076420:85 , srv1680204811:85 , srv180400214:85 , srv196329438:85 , srv2045443507:85 , srv205984227:85 , srv2070100477:85 , srv237765822:85 , srv24748753:85 , srv300770684:85 , srv353095060:85 , srv387447712:85 , srv574163393:85 , srv589211692:85 , srv648896352:85 , srv696819456:85 , srv69733682:85 , srv703181122:85 , srv817129747:85 , srv965214261:85 , srv985537654:85 , srv1197192641:86 , srv1244514573:86 , srv1411044580:86 , srv1427092702:86 , srv1446952332:86 , srv1510640042:86 , srv1542356669:86 , srv1567734747:86 , srv1688184030:86 , srv1861953802:86 , srv1955304191:86 , srv2083548719:86 , srv273980516:86 , srv338917817:86 , srv361334026:86 , srv382936917:86 , srv392432085:86 , srv495516808:86 , srv563916179:86 , srv643968592:86 , srv660742938:86 , srv827448087:86 , srv855786483:86 , srv87019983:86 , srv965507646:86 , srv1089873953:87 , srv1104713605:87 , srv1353890276:87 , srv1399306975:87 , srv1405159590:87 , srv1421938160:87 , srv1481198833:87 , srv1493540499:87 , srv1692052425:87 , srv1817643641:87 , srv198156813:87 , srv1999418448:87 , srv2017162508:87 , srv274996080:87 , srv326423711:87 , srv365350721:87 , srv497842337:87 , srv967295465:87 , srv1786528138:88 , srv1865023337:88 , srv526885625:88 , srv1058978460:550 }
2023-07-20 20:52:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:48,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:48,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:48,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:48,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:48,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:48,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:48,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:48,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:48,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:48,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:48,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:48,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:48,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:48,889 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0058900428744598655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009870087677015036); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0058900428744598655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:48,890 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-20 20:52:48,890 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011306230522641371, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0058900428744598655); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009870087677015036); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0058900428744598655); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-20 20:52:49,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 308 ms to try 5000 different iterations.  Found a solution that moves 277 regions; Going from a computed imbalance of 0.0011306230522641371 to a new imbalance of 3.6601017437007876E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.03077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:49,124 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1421938160:83 , srv1786528138:83 , srv196329438:83 , srv2082331713:83 , srv274996080:83 , srv495516808:83 , srv827448087:83 , srv1018079355:84 , srv1089873953:84 , srv1103815788:84 , srv1104713605:84 , srv1124883447:84 , srv1244514573:84 , srv1390288078:84 , srv1399306975:84 , srv1405159590:84 , srv1446952332:84 , srv1476109769:84 , srv1481198833:84 , srv1493540499:84 , srv1567734747:84 , srv1601724265:84 , srv1609076420:84 , srv1688184030:84 , srv180400214:84 , srv1817643641:84 , srv1955304191:84 , srv198156813:84 , srv1999418448:84 , srv2017162508:84 , srv237765822:84 , srv24748753:84 , srv262526491:84 , srv273980516:84 , srv353095060:84 , srv361334026:84 , srv365350721:84 , srv387447712:84 , srv497842337:84 , srv526885625:84 , srv589211692:84 , srv648896352:84 , srv660742938:84 , srv667397894:84 , srv696819456:84 , srv855786483:84 , srv87019983:84 , srv967295465:84 , srv985537654:84 , srv1050871371:85 , srv1076281879:85 , srv1257434036:85 , srv127390994:85 , srv1337198986:85 , srv1353890276:85 , srv1354388346:85 , srv1394558306:85 , srv1411044580:85 , srv1427092702:85 , srv143443824:85 , srv1485679487:85 , srv1503394050:85 , srv1510640042:85 , srv1513544900:85 , srv1526169573:85 , srv1542356669:85 , srv1670942162:85 , srv1680204811:85 , srv1692052425:85 , srv1766700540:85 , srv1861953802:85 , srv1865023337:85 , srv2070100477:85 , srv2083548719:85 , srv300770684:85 , srv326423711:85 , srv338917817:85 , srv379348924:85 , srv382936917:85 , srv392432085:85 , srv529405892:85 , srv563916179:85 , srv574163393:85 , srv62337671:85 , srv643968592:85 , srv69733682:85 , srv703181122:85 , srv817129747:85 , srv965214261:85 , srv965507646:85 , srv1032963095:86 , srv1116841667:86 , srv1197192641:86 , srv1304801295:86 , srv1742305819:86 , srv2045443507:86 , srv205984227:86 , srv450773753:86 , srv848818032:86 , srv1058978460:632 }
2023-07-20 20:52:49,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:49,128 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:49,138 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:49,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:49,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:49,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:49,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:49,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:49,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:49,228 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:49,229 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-20 20:52:49,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.466142198120294E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-20 20:52:49,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 268 ms to try 5000 different iterations.  Found a solution that moves 35 regions; Going from a computed imbalance of 3.466142198120294E-5 to a new imbalance of 6.277153977826465E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0038888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:49,445 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1050871371:83 , srv1116841667:83 , srv1197192641:83 , srv1411044580:83 , srv1692052425:83 , srv1865023337:83 , srv326423711:83 , srv392432085:83 , srv1032963095:84 , srv1076281879:84 , srv1089873953:84 , srv1103815788:84 , srv1104713605:84 , srv1124883447:84 , srv1244514573:84 , srv1257434036:84 , srv127390994:84 , srv1304801295:84 , srv1337198986:84 , srv1353890276:84 , srv1354388346:84 , srv1390288078:84 , srv1399306975:84 , srv1405159590:84 , srv1427092702:84 , srv143443824:84 , srv1446952332:84 , srv1476109769:84 , srv1481198833:84 , srv1485679487:84 , srv1493540499:84 , srv1503394050:84 , srv1510640042:84 , srv1513544900:84 , srv1526169573:84 , srv1542356669:84 , srv1567734747:84 , srv1601724265:84 , srv1609076420:84 , srv1670942162:84 , srv1680204811:84 , srv1688184030:84 , srv1742305819:84 , srv1766700540:84 , srv1786528138:84 , srv180400214:84 , srv1817643641:84 , srv1861953802:84 , srv1955304191:84 , srv196329438:84 , srv198156813:84 , srv2017162508:84 , srv2045443507:84 , srv205984227:84 , srv2070100477:84 , srv2082331713:84 , srv2083548719:84 , srv237765822:84 , srv24748753:84 , srv262526491:84 , srv273980516:84 , srv274996080:84 , srv300770684:84 , srv338917817:84 , srv353095060:84 , srv361334026:84 , srv365350721:84 , srv382936917:84 , srv450773753:84 , srv497842337:84 , srv526885625:84 , srv529405892:84 , srv563916179:84 , srv574163393:84 , srv589211692:84 , srv62337671:84 , srv643968592:84 , srv648896352:84 , srv660742938:84 , srv667397894:84 , srv696819456:84 , srv69733682:84 , srv703181122:84 , srv817129747:84 , srv848818032:84 , srv855786483:84 , srv87019983:84 , srv965214261:84 , srv965507646:84 , srv967295465:84 , srv985537654:84 , srv1018079355:85 , srv1394558306:85 , srv1421938160:85 , srv1999418448:85 , srv379348924:85 , srv387447712:85 , srv495516808:85 , srv827448087:85 , srv1058978460:684 }
2023-07-20 20:52:49,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:49,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1353890276=16, srv300770684=65, srv563916179=80, srv1304801295=14, srv274996080=64, srv817129747=91, srv1399306975=20, srv273980516=63, srv696819456=88, srv1050871371=2, srv361334026=69, srv1244514573=11, srv237765822=60, srv965214261=96, srv326423711=66, srv1032963095=1, srv1197192641=10, srv574163393=81, srv1405159590=21, srv1058978460=3, srv1567734747=36, srv1076281879=4, srv643968592=84, srv1446952332=26, srv1018079355=0, srv196329438=51, srv198156813=52, srv2045443507=55, srv87019983=95, srv965507646=97, srv1103815788=6, srv180400214=46, srv1786528138=45, srv589211692=82, srv1861953802=48, srv1476109769=27, srv382936917=72, srv1999418448=53, srv2070100477=57, srv1542356669=35, srv1601724265=37, srv1680204811=40, srv667397894=87, srv62337671=83, srv1503394050=31, srv495516808=76, srv450773753=75, srv205984227=56, srv1421938160=23, srv1394558306=19, srv1766700540=44, srv24748753=61, srv1427092702=24, srv2017162508=54, srv827448087=92, srv1955304191=50, srv1493540499=30, srv69733682=89, srv1510640042=32, srv855786483=94, srv1688184030=41, srv1513544900=33, srv848818032=93, srv353095060=68, srv1481198833=28, srv497842337=77, srv2083548719=59, srv379348924=71, srv2082331713=58, srv127390994=13, srv143443824=25, srv1390288078=18, srv1124883447=9, srv1485679487=29, srv985537654=99, srv660742938=86, srv967295465=98, srv338917817=67, srv1609076420=38, srv365350721=70, srv387447712=73, srv262526491=62, srv1692052425=42, srv1257434036=12, srv1742305819=43, srv1089873953=5, srv1337198986=15, srv1411044580=22, srv1116841667=8, srv648896352=85, srv1526169573=34, srv1670942162=39, srv1865023337=49, srv1354388346=17, srv1817643641=47, srv392432085=74, srv526885625=78, srv1104713605=7, srv703181122=90, srv529405892=79} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:49,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:49,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:49,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:49,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:49,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:49,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:49,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-20 20:52:49,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-20 20:52:49,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-20 20:52:49,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-20 20:52:49,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-20 20:52:49,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-20 20:52:49,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-20 20:52:49,575 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:49,576 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1050871371:83 , srv1116841667:83 , srv1197192641:83 , srv1411044580:83 , srv1692052425:83 , srv1865023337:83 , srv326423711:83 , srv392432085:83 , srv1032963095:84 , srv1076281879:84 , srv1089873953:84 , srv1103815788:84 , srv1104713605:84 , srv1124883447:84 , srv1244514573:84 , srv1257434036:84 , srv127390994:84 , srv1304801295:84 , srv1337198986:84 , srv1353890276:84 , srv1354388346:84 , srv1390288078:84 , srv1399306975:84 , srv1405159590:84 , srv1427092702:84 , srv143443824:84 , srv1446952332:84 , srv1476109769:84 , srv1481198833:84 , srv1485679487:84 , srv1493540499:84 , srv1503394050:84 , srv1510640042:84 , srv1513544900:84 , srv1526169573:84 , srv1542356669:84 , srv1567734747:84 , srv1601724265:84 , srv1609076420:84 , srv1670942162:84 , srv1680204811:84 , srv1688184030:84 , srv1742305819:84 , srv1766700540:84 , srv1786528138:84 , srv180400214:84 , srv1817643641:84 , srv1861953802:84 , srv1955304191:84 , srv196329438:84 , srv198156813:84 , srv2017162508:84 , srv2045443507:84 , srv205984227:84 , srv2070100477:84 , srv2082331713:84 , srv2083548719:84 , srv237765822:84 , srv24748753:84 , srv262526491:84 , srv273980516:84 , srv274996080:84 , srv300770684:84 , srv338917817:84 , srv353095060:84 , srv361334026:84 , srv365350721:84 , srv382936917:84 , srv450773753:84 , srv497842337:84 , srv526885625:84 , srv529405892:84 , srv563916179:84 , srv574163393:84 , srv589211692:84 , srv62337671:84 , srv643968592:84 , srv648896352:84 , srv660742938:84 , srv667397894:84 , srv696819456:84 , srv69733682:84 , srv703181122:84 , srv817129747:84 , srv848818032:84 , srv855786483:84 , srv87019983:84 , srv965214261:84 , srv965507646:84 , srv967295465:84 , srv985537654:84 , srv1018079355:85 , srv1394558306:85 , srv1421938160:85 , srv1999418448:85 , srv379348924:85 , srv387447712:85 , srv495516808:85 , srv827448087:85 , srv1058978460:684 }
2023-07-20 20:52:49,608 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 315) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=9962 (was 10667)
2023-07-20 20:52:49,615 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=170, AvailableMemoryMB=9961
2023-07-20 20:52:49,616 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-20 20:52:49,616 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-20 20:52:49,628 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1061279456:84 , srv1140692208:84 , srv1153067117:84 , srv1223796278:84 , srv1323214473:84 , srv1334568435:84 , srv1354266684:84 , srv1386303866:84 , srv1394378384:84 , srv1402241490:84 , srv1653422819:84 , srv1860691113:84 , srv1934414970:84 , srv1949255121:84 , srv1949413141:84 , srv2126641083:84 , srv279053499:84 , srv33820431:84 , srv36757117:84 , srv482972162:84 , srv529444077:84 , srv541944589:84 , srv685955289:84 , srv696240552:84 , srv716621559:84 , srv821479036:84 , srv827359496:84 , srv860293645:84 , srv99551479:84 , srv1171034685:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-20 20:52:49,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:52:49,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1949255121=14, srv696240552=24, srv1949413141=15, srv541944589=22, srv1140692208=1, srv1334568435=6, srv1934414970=13, srv716621559=25, srv1402241490=10, srv1653422819=11, srv1061279456=0, srv529444077=21, srv1354266684=7, srv1223796278=4, srv99551479=29, srv860293645=28, srv2126641083=16, srv1394378384=9, srv1860691113=12, srv279053499=17, srv33820431=18, srv1386303866=8, srv482972162=20, srv685955289=23, srv827359496=27, srv1171034685=3, srv1153067117=2, srv821479036=26, srv1323214473=5, srv36757117=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:52:49,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:52:49,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:52:49,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:52:49,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:52:49,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:52:49,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:52:49,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-20 20:52:49,668 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1524783169780046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:52:49,668 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912673497462202, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1524783169780046, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-20 20:54:49,648 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9368299 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912673497462202 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:54:49,654 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061279456:90 , srv1140692208:90 , srv1153067117:90 , srv1171034685:90 , srv1223796278:90 , srv1323214473:90 , srv1334568435:90 , srv1354266684:90 , srv1386303866:90 , srv1394378384:90 , srv1402241490:90 , srv1653422819:90 , srv1860691113:90 , srv1934414970:90 , srv1949255121:90 , srv1949413141:90 , srv2126641083:90 , srv279053499:90 , srv33820431:90 , srv36757117:90 , srv482972162:90 , srv529444077:90 , srv541944589:90 , srv685955289:90 , srv696240552:90 , srv716621559:90 , srv821479036:90 , srv827359496:90 , srv860293645:90 , srv99551479:90 }
2023-07-20 20:54:49,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-20 20:54:49,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1949255121=14, srv696240552=24, srv1949413141=15, srv541944589=22, srv1140692208=1, srv1334568435=6, srv1934414970=13, srv716621559=25, srv1402241490=10, srv1653422819=11, srv1061279456=0, srv529444077=21, srv1354266684=7, srv1223796278=4, srv99551479=29, srv860293645=28, srv2126641083=16, srv1394378384=9, srv1860691113=12, srv279053499=17, srv33820431=18, srv1386303866=8, srv482972162=20, srv685955289=23, srv827359496=27, srv1171034685=3, srv1153067117=2, srv821479036=26, srv1323214473=5, srv36757117=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-20 20:54:49,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-20 20:54:49,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-20 20:54:49,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-20 20:54:49,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-20 20:54:49,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-20 20:54:49,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-20 20:54:49,669 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-20 20:54:49,669 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1061279456:90 , srv1140692208:90 , srv1153067117:90 , srv1171034685:90 , srv1223796278:90 , srv1323214473:90 , srv1334568435:90 , srv1354266684:90 , srv1386303866:90 , srv1394378384:90 , srv1402241490:90 , srv1653422819:90 , srv1860691113:90 , srv1934414970:90 , srv1949255121:90 , srv1949413141:90 , srv2126641083:90 , srv279053499:90 , srv33820431:90 , srv36757117:90 , srv482972162:90 , srv529444077:90 , srv541944589:90 , srv685955289:90 , srv696240552:90 , srv716621559:90 , srv821479036:90 , srv827359496:90 , srv860293645:90 , srv99551479:90 }
2023-07-20 20:54:49,680 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 354), ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=9527 (was 9961)