2023-10-01 06:58:47,573 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-01 06:58:47,817 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-01 06:58:47,902 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-01 06:58:47,950 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 06:58:47,956 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-01 06:58:47,966 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=167, AvailableMemoryMB=5975
2023-10-01 06:58:47,968 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 06:58:47,969 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-01 06:58:48,084 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009589402:84 , srv1013119325:84 , srv103725378:84 , srv1097406313:84 , srv1112275664:84 , srv113521002:84 , srv1189813461:84 , srv119773296:84 , srv1198521250:84 , srv1205542085:84 , srv1206761150:84 , srv1214390263:84 , srv1262325558:84 , srv1279734284:84 , srv1286648248:84 , srv1291015771:84 , srv1295891031:84 , srv1309224277:84 , srv1323618964:84 , srv1378802567:84 , srv1412260877:84 , srv1455665054:84 , srv1471797470:84 , srv1472864612:84 , srv1475457008:84 , srv1476801690:84 , srv1543088311:84 , srv1548333410:84 , srv1558275962:84 , srv1595164787:84 , srv1597972918:84 , srv1613389538:84 , srv1635682506:84 , srv164299339:84 , srv1651742992:84 , srv1681918437:84 , srv1688240726:84 , srv1695085672:84 , srv1727120536:84 , srv1774901239:84 , srv1796173550:84 , srv184404208:84 , srv1852783760:84 , srv1865794689:84 , srv1928306681:84 , srv1940634700:84 , srv1979874917:84 , srv1993317820:84 , srv1999219353:84 , srv2004284708:84 , srv200729062:84 , srv2032533676:84 , srv2040701164:84 , srv2076870326:84 , srv208122442:84 , srv2115342568:84 , srv2135632037:84 , srv214009313:84 , srv225188036:84 , srv240217930:84 , srv257196969:84 , srv262777193:84 , srv30087943:84 , srv341106021:84 , srv341928102:84 , srv36148535:84 , srv368605840:84 , srv410701403:84 , srv412877326:84 , srv419268084:84 , srv444080395:84 , srv474520616:84 , srv482341937:84 , srv492565364:84 , srv520304852:84 , srv557415972:84 , srv578066972:84 , srv583849323:84 , srv591030072:84 , srv592717798:84 , srv638327082:84 , srv638837028:84 , srv650067969:84 , srv664811495:84 , srv666202078:84 , srv671810490:84 , srv700732737:84 , srv711805925:84 , srv783476631:84 , srv834604884:84 , srv867017834:84 , srv889116132:84 , srv900065085:84 , srv918987865:84 , srv928034233:84 , srv962412464:84 , srv974897807:84 , srv989680950:84 , srv998798003:84 , srv886304254:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-01 06:58:48,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:48,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834604884=89, srv1214390263=11, srv2032533676=51, srv1774901239=39, srv1262325558=12, srv886304254=91, srv650067969=82, srv900065085=93, srv989680950=98, srv36148535=65, srv341928102=64, srv2040701164=52, srv928034233=95, srv1412260877=20, srv1286648248=14, srv119773296=7, srv1635682506=32, srv700732737=86, srv2076870326=53, srv591030072=78, srv412877326=68, srv592717798=79, srv638327082=80, srv578066972=76, srv1999219353=48, srv1472864612=23, srv1323618964=18, srv1681918437=35, srv520304852=74, srv1013119325=1, srv2115342568=55, srv103725378=2, srv1097406313=3, srv419268084=69, srv1291015771=15, srv1597972918=30, srv1205542085=9, srv262777193=61, srv30087943=62, srv1613389538=31, srv1865794689=43, srv225188036=58, srv492565364=73, srv1928306681=44, srv164299339=33, srv1475457008=24, srv1206761150=10, srv1309224277=17, srv1940634700=45, srv1009589402=0, srv1476801690=25, srv1695085672=37, srv200729062=50, srv2004284708=49, srv638837028=81, srv1189813461=6, srv867017834=90, srv998798003=99, srv184404208=41, srv1112275664=4, srv368605840=66, srv1198521250=8, srv482341937=72, srv1727120536=38, srv1279734284=13, srv1651742992=34, srv1979874917=46, srv1378802567=19, srv918987865=94, srv666202078=84, srv1543088311=26, srv671810490=85, srv711805925=87, srv1993317820=47, srv889116132=92, srv341106021=63, srv1852783760=42, srv974897807=97, srv1595164787=29, srv1796173550=40, srv474520616=71, srv2135632037=56, srv783476631=88, srv1295891031=16, srv214009313=57, srv1548333410=27, srv664811495=83, srv257196969=60, srv583849323=77, srv113521002=5, srv1455665054=21, srv208122442=54, srv962412464=96, srv1558275962=28, srv1471797470=22, srv1688240726=36, srv240217930=59, srv557415972=75, srv410701403=67, srv444080395=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:48,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:48,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:48,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:48,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:48,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:48,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:48,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:48,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 06:58:48,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 06:58:48,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 06:58:48,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 06:58:48,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 06:58:48,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 06:58:48,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 06:58:48,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 06:58:48,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 06:58:48,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 06:58:48,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 06:58:48,552 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:48,552 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 06:58:48,553 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 06:58:48,944 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 691 ms to try 5000 different iterations.  Found a solution that moves 4622 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18709086627895333. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038689310661119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05424722059940898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5135555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038689310661119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18208333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:48,952 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1796173550:82 , srv2040701164:82 , srv240217930:82 , srv474520616:82 , srv664811495:82 , srv834604884:82 , srv1214390263:83 , srv184404208:83 , srv1852783760:83 , srv700732737:83 , srv918987865:83 , srv1009589402:84 , srv1558275962:84 , srv1597972918:84 , srv1681918437:84 , srv1695085672:84 , srv257196969:84 , srv492565364:84 , srv867017834:84 , srv962412464:84 , srv1097406313:85 , srv1112275664:85 , srv113521002:85 , srv1189813461:85 , srv1205542085:85 , srv1206761150:85 , srv1262325558:85 , srv1291015771:85 , srv1455665054:85 , srv1471797470:85 , srv1476801690:85 , srv1651742992:85 , srv1727120536:85 , srv2076870326:85 , srv225188036:85 , srv444080395:85 , srv592717798:85 , srv638837028:85 , srv974897807:85 , srv1412260877:86 , srv1475457008:86 , srv164299339:86 , srv30087943:86 , srv419268084:86 , srv578066972:86 , srv666202078:86 , srv671810490:86 , srv711805925:86 , srv889116132:86 , srv900065085:86 , srv1013119325:87 , srv1286648248:87 , srv1309224277:87 , srv1472864612:87 , srv1543088311:87 , srv1635682506:87 , srv1865794689:87 , srv1999219353:87 , srv200729062:87 , srv2032533676:87 , srv2135632037:87 , srv214009313:87 , srv368605840:87 , srv410701403:87 , srv482341937:87 , srv520304852:87 , srv583849323:87 , srv638327082:87 , srv650067969:87 , srv783476631:87 , srv928034233:87 , srv998798003:87 , srv1198521250:88 , srv1279734284:88 , srv1378802567:88 , srv1595164787:88 , srv1613389538:88 , srv1688240726:88 , srv1940634700:88 , srv1993317820:88 , srv2004284708:88 , srv341928102:88 , srv36148535:88 , srv412877326:88 , srv557415972:88 , srv989680950:88 , srv119773296:89 , srv1295891031:89 , srv1548333410:89 , srv1774901239:89 , srv1979874917:89 , srv2115342568:89 , srv103725378:90 , srv1323618964:91 , srv1928306681:93 , srv208122442:93 , srv341106021:93 , srv591030072:93 , srv262777193:94 , srv886304254:449 }
2023-10-01 06:58:48,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:48,956 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834604884=89, srv1214390263=11, srv2032533676=51, srv1774901239=39, srv1262325558=12, srv886304254=91, srv650067969=82, srv900065085=93, srv989680950=98, srv36148535=65, srv341928102=64, srv2040701164=52, srv928034233=95, srv1412260877=20, srv1286648248=14, srv119773296=7, srv1635682506=32, srv700732737=86, srv2076870326=53, srv591030072=78, srv412877326=68, srv592717798=79, srv638327082=80, srv578066972=76, srv1999219353=48, srv1472864612=23, srv1323618964=18, srv1681918437=35, srv520304852=74, srv1013119325=1, srv2115342568=55, srv103725378=2, srv1097406313=3, srv419268084=69, srv1291015771=15, srv1597972918=30, srv1205542085=9, srv262777193=61, srv30087943=62, srv1613389538=31, srv1865794689=43, srv225188036=58, srv492565364=73, srv1928306681=44, srv164299339=33, srv1475457008=24, srv1206761150=10, srv1309224277=17, srv1940634700=45, srv1009589402=0, srv1476801690=25, srv1695085672=37, srv200729062=50, srv2004284708=49, srv638837028=81, srv1189813461=6, srv867017834=90, srv998798003=99, srv184404208=41, srv1112275664=4, srv368605840=66, srv1198521250=8, srv482341937=72, srv1727120536=38, srv1279734284=13, srv1651742992=34, srv1979874917=46, srv1378802567=19, srv918987865=94, srv666202078=84, srv1543088311=26, srv671810490=85, srv711805925=87, srv1993317820=47, srv889116132=92, srv341106021=63, srv1852783760=42, srv974897807=97, srv1595164787=29, srv1796173550=40, srv474520616=71, srv2135632037=56, srv783476631=88, srv1295891031=16, srv214009313=57, srv1548333410=27, srv664811495=83, srv257196969=60, srv583849323=77, srv113521002=5, srv1455665054=21, srv208122442=54, srv962412464=96, srv1558275962=28, srv1471797470=22, srv1688240726=36, srv240217930=59, srv557415972=75, srv410701403=67, srv444080395=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:48,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:48,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:48,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:48,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:48,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:48,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 06:58:48,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 06:58:48,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 06:58:48,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 06:58:48,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 06:58:48,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 06:58:49,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038689310661119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05424722059940898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038689310661119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18208333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,084 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 06:58:49,084 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18705850234322507, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04038689310661119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05424722059940898, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04038689310661119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18208333333333335, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2520833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 06:58:49,280 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 290 ms to try 5000 different iterations.  Found a solution that moves 2745 regions; Going from a computed imbalance of 0.18705850234322507 to a new imbalance of 0.013540183658605825. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022512138029254582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.305, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022512138029254582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04733333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,290 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv262777193:77 , srv1928306681:78 , srv208122442:78 , srv591030072:79 , srv1613389538:80 , srv341106021:80 , srv1595164787:81 , srv1323618964:82 , srv1378802567:82 , srv1774901239:82 , srv214009313:82 , srv341928102:82 , srv557415972:82 , srv2115342568:83 , srv36148535:83 , srv650067969:83 , srv989680950:83 , srv1013119325:84 , srv1198521250:84 , srv1295891031:84 , srv1543088311:84 , srv1865794689:84 , srv1940634700:84 , srv1979874917:84 , srv1993317820:84 , srv2004284708:84 , srv2135632037:84 , srv410701403:84 , srv520304852:84 , srv889116132:84 , srv928034233:84 , srv998798003:84 , srv103725378:85 , srv1189813461:85 , srv1291015771:85 , srv1412260877:85 , srv1472864612:85 , srv1475457008:85 , srv1548333410:85 , srv1635682506:85 , srv1688240726:85 , srv2032533676:85 , srv638837028:85 , srv711805925:85 , srv1009589402:86 , srv1097406313:86 , srv119773296:86 , srv1206761150:86 , srv1286648248:86 , srv1309224277:86 , srv164299339:86 , srv1651742992:86 , srv1681918437:86 , srv200729062:86 , srv30087943:86 , srv412877326:86 , srv419268084:86 , srv482341937:86 , srv492565364:86 , srv666202078:86 , srv671810490:86 , srv1112275664:87 , srv113521002:87 , srv1279734284:87 , srv1455665054:87 , srv1695085672:87 , srv1727120536:87 , srv1999219353:87 , srv2076870326:87 , srv225188036:87 , srv368605840:87 , srv444080395:87 , srv583849323:87 , srv783476631:87 , srv900065085:87 , srv974897807:87 , srv1205542085:88 , srv1214390263:88 , srv1476801690:88 , srv1796173550:88 , srv1852783760:88 , srv257196969:88 , srv867017834:88 , srv1262325558:89 , srv1471797470:89 , srv1558275962:89 , srv1597972918:89 , srv2040701164:89 , srv474520616:89 , srv592717798:89 , srv638327082:89 , srv184404208:90 , srv664811495:90 , srv834604884:90 , srv918987865:90 , srv962412464:90 , srv240217930:91 , srv578066972:91 , srv700732737:91 , srv886304254:525 }
2023-10-01 06:58:49,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:49,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834604884=89, srv1214390263=11, srv2032533676=51, srv1774901239=39, srv1262325558=12, srv886304254=91, srv650067969=82, srv900065085=93, srv989680950=98, srv36148535=65, srv341928102=64, srv2040701164=52, srv928034233=95, srv1412260877=20, srv1286648248=14, srv119773296=7, srv1635682506=32, srv700732737=86, srv2076870326=53, srv591030072=78, srv412877326=68, srv592717798=79, srv638327082=80, srv578066972=76, srv1999219353=48, srv1472864612=23, srv1323618964=18, srv1681918437=35, srv520304852=74, srv1013119325=1, srv2115342568=55, srv103725378=2, srv1097406313=3, srv419268084=69, srv1291015771=15, srv1597972918=30, srv1205542085=9, srv262777193=61, srv30087943=62, srv1613389538=31, srv1865794689=43, srv225188036=58, srv492565364=73, srv1928306681=44, srv164299339=33, srv1475457008=24, srv1206761150=10, srv1309224277=17, srv1940634700=45, srv1009589402=0, srv1476801690=25, srv1695085672=37, srv200729062=50, srv2004284708=49, srv638837028=81, srv1189813461=6, srv867017834=90, srv998798003=99, srv184404208=41, srv1112275664=4, srv368605840=66, srv1198521250=8, srv482341937=72, srv1727120536=38, srv1279734284=13, srv1651742992=34, srv1979874917=46, srv1378802567=19, srv918987865=94, srv666202078=84, srv1543088311=26, srv671810490=85, srv711805925=87, srv1993317820=47, srv889116132=92, srv341106021=63, srv1852783760=42, srv974897807=97, srv1595164787=29, srv1796173550=40, srv474520616=71, srv2135632037=56, srv783476631=88, srv1295891031=16, srv214009313=57, srv1548333410=27, srv664811495=83, srv257196969=60, srv583849323=77, srv113521002=5, srv1455665054=21, srv208122442=54, srv962412464=96, srv1558275962=28, srv1471797470=22, srv1688240726=36, srv240217930=59, srv557415972=75, srv410701403=67, srv444080395=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:49,312 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:49,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 06:58:49,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 06:58:49,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 06:58:49,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 06:58:49,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 06:58:49,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 06:58:49,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 06:58:49,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 06:58:49,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 06:58:49,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022512138029254582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022512138029254582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04733333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,415 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 06:58:49,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013520962757789273, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022512138029254582); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03298130613594952, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022512138029254582); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04733333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 06:58:49,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 238 ms to try 5000 different iterations.  Found a solution that moves 975 regions; Going from a computed imbalance of 0.013520962757789273 to a new imbalance of 6.731032165155344E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006878417877522249); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008989331499509895); MoveCostFunction : (multiplier=7.0, imbalance=0.10833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006878417877522249); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,576 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv578066972:80 , srv638327082:80 , srv103725378:82 , srv1279734284:82 , srv119773296:83 , srv1548333410:83 , srv1999219353:83 , srv583849323:83 , srv1205542085:84 , srv1262325558:84 , srv1309224277:84 , srv1323618964:84 , srv1476801690:84 , srv184404208:84 , srv1940634700:84 , srv200729062:84 , srv240217930:84 , srv412877326:84 , srv482341937:84 , srv592717798:84 , srv700732737:84 , srv783476631:84 , srv962412464:84 , srv1112275664:85 , srv1198521250:85 , srv1286648248:85 , srv1295891031:85 , srv1455665054:85 , srv1471797470:85 , srv1475457008:85 , srv1558275962:85 , srv1597972918:85 , srv1635682506:85 , srv1688240726:85 , srv1727120536:85 , srv1979874917:85 , srv2004284708:85 , srv2032533676:85 , srv2076870326:85 , srv2115342568:85 , srv225188036:85 , srv341106021:85 , srv368605840:85 , srv410701403:85 , srv419268084:85 , srv591030072:85 , srv664811495:85 , srv666202078:85 , srv671810490:85 , srv867017834:85 , srv900065085:85 , srv918987865:85 , srv1097406313:86 , srv113521002:86 , srv1214390263:86 , srv1412260877:86 , srv1472864612:86 , srv164299339:86 , srv1695085672:86 , srv1774901239:86 , srv1852783760:86 , srv1865794689:86 , srv1993317820:86 , srv208122442:86 , srv2135632037:86 , srv257196969:86 , srv262777193:86 , srv30087943:86 , srv444080395:86 , srv474520616:86 , srv711805925:86 , srv834604884:86 , srv928034233:86 , srv974897807:86 , srv998798003:86 , srv1009589402:87 , srv1013119325:87 , srv1206761150:87 , srv1291015771:87 , srv1543088311:87 , srv1651742992:87 , srv1681918437:87 , srv1928306681:87 , srv2040701164:87 , srv341928102:87 , srv36148535:87 , srv492565364:87 , srv520304852:87 , srv557415972:87 , srv650067969:87 , srv889116132:87 , srv989680950:87 , srv1189813461:88 , srv1378802567:88 , srv1595164787:88 , srv1796173550:88 , srv214009313:88 , srv638837028:88 , srv1613389538:89 , srv886304254:545 }
2023-10-01 06:58:49,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:49,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834604884=89, srv1214390263=11, srv2032533676=51, srv1774901239=39, srv1262325558=12, srv886304254=91, srv650067969=82, srv900065085=93, srv989680950=98, srv36148535=65, srv341928102=64, srv2040701164=52, srv928034233=95, srv1412260877=20, srv1286648248=14, srv119773296=7, srv1635682506=32, srv700732737=86, srv2076870326=53, srv591030072=78, srv412877326=68, srv592717798=79, srv638327082=80, srv578066972=76, srv1999219353=48, srv1472864612=23, srv1323618964=18, srv1681918437=35, srv520304852=74, srv1013119325=1, srv2115342568=55, srv103725378=2, srv1097406313=3, srv419268084=69, srv1291015771=15, srv1597972918=30, srv1205542085=9, srv262777193=61, srv30087943=62, srv1613389538=31, srv1865794689=43, srv225188036=58, srv492565364=73, srv1928306681=44, srv164299339=33, srv1475457008=24, srv1206761150=10, srv1309224277=17, srv1940634700=45, srv1009589402=0, srv1476801690=25, srv1695085672=37, srv200729062=50, srv2004284708=49, srv638837028=81, srv1189813461=6, srv867017834=90, srv998798003=99, srv184404208=41, srv1112275664=4, srv368605840=66, srv1198521250=8, srv482341937=72, srv1727120536=38, srv1279734284=13, srv1651742992=34, srv1979874917=46, srv1378802567=19, srv918987865=94, srv666202078=84, srv1543088311=26, srv671810490=85, srv711805925=87, srv1993317820=47, srv889116132=92, srv341106021=63, srv1852783760=42, srv974897807=97, srv1595164787=29, srv1796173550=40, srv474520616=71, srv2135632037=56, srv783476631=88, srv1295891031=16, srv214009313=57, srv1548333410=27, srv664811495=83, srv257196969=60, srv583849323=77, srv113521002=5, srv1455665054=21, srv208122442=54, srv962412464=96, srv1558275962=28, srv1471797470=22, srv1688240726=36, srv240217930=59, srv557415972=75, srv410701403=67, srv444080395=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:49,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:49,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 06:58:49,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 06:58:49,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 06:58:49,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 06:58:49,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 06:58:49,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 06:58:49,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006878417877522249); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008989331499509895); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006878417877522249); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,704 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-01 06:58:49,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.662761205970874E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006878417877522249); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008989331499509895); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006878417877522249); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004083333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-01 06:58:49,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 310 ms to try 5000 different iterations.  Found a solution that moves 272 regions; Going from a computed imbalance of 6.662761205970874E-4 to a new imbalance of 2.0807644758122637E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.030222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:49,920 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1471797470:83 , srv1472864612:83 , srv1993317820:83 , srv1013119325:84 , srv113521002:84 , srv1189813461:84 , srv119773296:84 , srv1262325558:84 , srv1286648248:84 , srv1295891031:84 , srv1323618964:84 , srv1378802567:84 , srv1543088311:84 , srv1558275962:84 , srv1597972918:84 , srv164299339:84 , srv1681918437:84 , srv1688240726:84 , srv1796173550:84 , srv1928306681:84 , srv1979874917:84 , srv2040701164:84 , srv257196969:84 , srv30087943:84 , srv341106021:84 , srv36148535:84 , srv368605840:84 , srv412877326:84 , srv444080395:84 , srv520304852:84 , srv592717798:84 , srv638837028:84 , srv650067969:84 , srv700732737:84 , srv783476631:84 , srv834604884:84 , srv900065085:84 , srv918987865:84 , srv962412464:84 , srv974897807:84 , srv989680950:84 , srv1009589402:85 , srv103725378:85 , srv1097406313:85 , srv1112275664:85 , srv1198521250:85 , srv1205542085:85 , srv1206761150:85 , srv1214390263:85 , srv1279734284:85 , srv1291015771:85 , srv1309224277:85 , srv1412260877:85 , srv1455665054:85 , srv1476801690:85 , srv1548333410:85 , srv1595164787:85 , srv1613389538:85 , srv1635682506:85 , srv1651742992:85 , srv1695085672:85 , srv1727120536:85 , srv1774901239:85 , srv184404208:85 , srv1852783760:85 , srv1865794689:85 , srv1940634700:85 , srv1999219353:85 , srv2004284708:85 , srv200729062:85 , srv2032533676:85 , srv2076870326:85 , srv208122442:85 , srv2115342568:85 , srv2135632037:85 , srv214009313:85 , srv225188036:85 , srv240217930:85 , srv262777193:85 , srv341928102:85 , srv419268084:85 , srv474520616:85 , srv482341937:85 , srv557415972:85 , srv591030072:85 , srv664811495:85 , srv666202078:85 , srv671810490:85 , srv711805925:85 , srv867017834:85 , srv889116132:85 , srv928034233:85 , srv998798003:85 , srv1475457008:86 , srv410701403:86 , srv492565364:86 , srv578066972:86 , srv583849323:86 , srv638327082:86 , srv886304254:623 }
2023-10-01 06:58:49,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:49,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv834604884=89, srv1214390263=11, srv2032533676=51, srv1774901239=39, srv1262325558=12, srv886304254=91, srv650067969=82, srv900065085=93, srv989680950=98, srv36148535=65, srv341928102=64, srv2040701164=52, srv928034233=95, srv1412260877=20, srv1286648248=14, srv119773296=7, srv1635682506=32, srv700732737=86, srv2076870326=53, srv591030072=78, srv412877326=68, srv592717798=79, srv638327082=80, srv578066972=76, srv1999219353=48, srv1472864612=23, srv1323618964=18, srv1681918437=35, srv520304852=74, srv1013119325=1, srv2115342568=55, srv103725378=2, srv1097406313=3, srv419268084=69, srv1291015771=15, srv1597972918=30, srv1205542085=9, srv262777193=61, srv30087943=62, srv1613389538=31, srv1865794689=43, srv225188036=58, srv492565364=73, srv1928306681=44, srv164299339=33, srv1475457008=24, srv1206761150=10, srv1309224277=17, srv1940634700=45, srv1009589402=0, srv1476801690=25, srv1695085672=37, srv200729062=50, srv2004284708=49, srv638837028=81, srv1189813461=6, srv867017834=90, srv998798003=99, srv184404208=41, srv1112275664=4, srv368605840=66, srv1198521250=8, srv482341937=72, srv1727120536=38, srv1279734284=13, srv1651742992=34, srv1979874917=46, srv1378802567=19, srv918987865=94, srv666202078=84, srv1543088311=26, srv671810490=85, srv711805925=87, srv1993317820=47, srv889116132=92, srv341106021=63, srv1852783760=42, srv974897807=97, srv1595164787=29, srv1796173550=40, srv474520616=71, srv2135632037=56, srv783476631=88, srv1295891031=16, srv214009313=57, srv1548333410=27, srv664811495=83, srv257196969=60, srv583849323=77, srv113521002=5, srv1455665054=21, srv208122442=54, srv962412464=96, srv1558275962=28, srv1471797470=22, srv1688240726=36, srv240217930=59, srv557415972=75, srv410701403=67, srv444080395=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:49,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:49,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-01 06:58:49,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-01 06:58:49,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-01 06:58:49,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-01 06:58:49,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-01 06:58:49,941 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-01 06:58:49,942 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-01 06:58:49,943 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-01 06:58:49,944 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-01 06:58:50,025 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.8903060050617428E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:50,025 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1471797470:83 , srv1472864612:83 , srv1993317820:83 , srv1013119325:84 , srv113521002:84 , srv1189813461:84 , srv119773296:84 , srv1262325558:84 , srv1286648248:84 , srv1295891031:84 , srv1323618964:84 , srv1378802567:84 , srv1543088311:84 , srv1558275962:84 , srv1597972918:84 , srv164299339:84 , srv1681918437:84 , srv1688240726:84 , srv1796173550:84 , srv1928306681:84 , srv1979874917:84 , srv2040701164:84 , srv257196969:84 , srv30087943:84 , srv341106021:84 , srv36148535:84 , srv368605840:84 , srv412877326:84 , srv444080395:84 , srv520304852:84 , srv592717798:84 , srv638837028:84 , srv650067969:84 , srv700732737:84 , srv783476631:84 , srv834604884:84 , srv900065085:84 , srv918987865:84 , srv962412464:84 , srv974897807:84 , srv989680950:84 , srv1009589402:85 , srv103725378:85 , srv1097406313:85 , srv1112275664:85 , srv1198521250:85 , srv1205542085:85 , srv1206761150:85 , srv1214390263:85 , srv1279734284:85 , srv1291015771:85 , srv1309224277:85 , srv1412260877:85 , srv1455665054:85 , srv1476801690:85 , srv1548333410:85 , srv1595164787:85 , srv1613389538:85 , srv1635682506:85 , srv1651742992:85 , srv1695085672:85 , srv1727120536:85 , srv1774901239:85 , srv184404208:85 , srv1852783760:85 , srv1865794689:85 , srv1940634700:85 , srv1999219353:85 , srv2004284708:85 , srv200729062:85 , srv2032533676:85 , srv2076870326:85 , srv208122442:85 , srv2115342568:85 , srv2135632037:85 , srv214009313:85 , srv225188036:85 , srv240217930:85 , srv262777193:85 , srv341928102:85 , srv419268084:85 , srv474520616:85 , srv482341937:85 , srv557415972:85 , srv591030072:85 , srv664811495:85 , srv666202078:85 , srv671810490:85 , srv711805925:85 , srv867017834:85 , srv889116132:85 , srv928034233:85 , srv998798003:85 , srv1475457008:86 , srv410701403:86 , srv492565364:86 , srv578066972:86 , srv583849323:86 , srv638327082:86 , srv886304254:623 }
2023-10-01 06:58:50,055 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 200), ProcessCount=167 (was 167), AvailableMemoryMB=5551 (was 5975)
2023-10-01 06:58:50,061 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=167, AvailableMemoryMB=5550
2023-10-01 06:58:50,062 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-01 06:58:50,062 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-01 06:58:50,077 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv108079384:84 , srv1115085996:84 , srv1148761714:84 , srv1219118908:84 , srv1243180606:84 , srv1287759282:84 , srv1398428220:84 , srv1519646891:84 , srv1645193316:84 , srv164852094:84 , srv17726759:84 , srv1822740007:84 , srv1878737850:84 , srv1935781485:84 , srv1939424413:84 , srv2132525857:84 , srv2137290167:84 , srv275693755:84 , srv290855404:84 , srv365176715:84 , srv507903016:84 , srv530409348:84 , srv542855291:84 , srv570677680:84 , srv702859283:84 , srv807360824:84 , srv826999950:84 , srv905050064:84 , srv943807387:84 , srv500388006:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-01 06:58:50,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 06:58:50,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv164852094=9, srv1939424413=14, srv702859283=25, srv826999950=27, srv500388006=20, srv2132525857=15, srv108079384=0, srv1398428220=6, srv275693755=17, srv1148761714=2, srv1519646891=7, srv943807387=29, srv2137290167=16, srv17726759=10, srv1115085996=1, srv905050064=28, srv507903016=21, srv807360824=26, srv1645193316=8, srv1822740007=11, srv1287759282=5, srv365176715=19, srv290855404=18, srv570677680=24, srv1243180606=4, srv1935781485=13, srv530409348=22, srv1219118908=3, srv1878737850=12, srv542855291=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 06:58:50,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 06:58:50,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 06:58:50,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 06:58:50,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 06:58:50,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-01 06:58:50,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1366302113287459, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 06:58:50,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912623560598789, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1366302113287459, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-01 07:00:50,098 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9957287 different iterations.  Found a solution that moves 1841 regions; Going from a computed imbalance of 0.9912623560598789 to a new imbalance of 4.296985841319951E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6818518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 07:00:50,104 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv108079384:90 , srv1115085996:90 , srv1148761714:90 , srv1219118908:90 , srv1243180606:90 , srv1287759282:90 , srv1398428220:90 , srv1519646891:90 , srv1645193316:90 , srv164852094:90 , srv17726759:90 , srv1822740007:90 , srv1878737850:90 , srv1935781485:90 , srv1939424413:90 , srv2132525857:90 , srv2137290167:90 , srv275693755:90 , srv290855404:90 , srv365176715:90 , srv500388006:90 , srv507903016:90 , srv530409348:90 , srv542855291:90 , srv570677680:90 , srv702859283:90 , srv807360824:90 , srv826999950:90 , srv905050064:90 , srv943807387:90 }
2023-10-01 07:00:50,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-01 07:00:50,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv164852094=9, srv1939424413=14, srv702859283=25, srv826999950=27, srv500388006=20, srv2132525857=15, srv108079384=0, srv1398428220=6, srv275693755=17, srv1148761714=2, srv1519646891=7, srv943807387=29, srv2137290167=16, srv17726759=10, srv1115085996=1, srv905050064=28, srv507903016=21, srv807360824=26, srv1645193316=8, srv1822740007=11, srv1287759282=5, srv365176715=19, srv290855404=18, srv570677680=24, srv1243180606=4, srv1935781485=13, srv530409348=22, srv1219118908=3, srv1878737850=12, srv542855291=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-01 07:00:50,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-01 07:00:50,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-01 07:00:50,118 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-01 07:00:50,118 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv108079384:90 , srv1115085996:90 , srv1148761714:90 , srv1219118908:90 , srv1243180606:90 , srv1287759282:90 , srv1398428220:90 , srv1519646891:90 , srv1645193316:90 , srv164852094:90 , srv17726759:90 , srv1822740007:90 , srv1878737850:90 , srv1935781485:90 , srv1939424413:90 , srv2132525857:90 , srv2137290167:90 , srv275693755:90 , srv290855404:90 , srv365176715:90 , srv500388006:90 , srv507903016:90 , srv530409348:90 , srv542855291:90 , srv570677680:90 , srv702859283:90 , srv807360824:90 , srv826999950:90 , srv905050064:90 , srv943807387:90 }
2023-10-01 07:00:50,129 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 200), ProcessCount=166 (was 167), AvailableMemoryMB=6406 (was 5550) - AvailableMemoryMB LEAK? -