2023-03-08 07:54:13,749 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-08 07:54:14,068 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-08 07:54:14,173 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-08 07:54:14,234 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 07:54:14,242 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 07:54:14,255 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=172, AvailableMemoryMB=8221
2023-03-08 07:54:14,257 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 07:54:14,257 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 07:54:14,377 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv100758040:84 , srv1042312251:84 , srv1080385346:84 , srv1089358453:84 , srv1114900148:84 , srv1133393388:84 , srv1136540653:84 , srv1145035075:84 , srv1158445949:84 , srv1165537795:84 , srv1208032590:84 , srv1256101868:84 , srv1291491100:84 , srv1304434371:84 , srv1329970784:84 , srv1337320114:84 , srv1355190357:84 , srv139233958:84 , srv1437642389:84 , srv1458639991:84 , srv1485280017:84 , srv1485693974:84 , srv1512570329:84 , srv1549626063:84 , srv1561787415:84 , srv1580901732:84 , srv1621933728:84 , srv1622867143:84 , srv1624272012:84 , srv1661079740:84 , srv1667614916:84 , srv1677559265:84 , srv1689786281:84 , srv1696806034:84 , srv1747553890:84 , srv1800520280:84 , srv1817192028:84 , srv1841462103:84 , srv184204744:84 , srv1859375625:84 , srv1862401918:84 , srv186966301:84 , srv1900079443:84 , srv191116460:84 , srv1934148090:84 , srv1955336860:84 , srv1964083380:84 , srv1975752884:84 , srv1980235573:84 , srv1985231426:84 , srv1989394159:84 , srv1992731439:84 , srv2016311300:84 , srv2018146452:84 , srv2045635292:84 , srv2090007568:84 , srv2095818604:84 , srv2099769856:84 , srv2121809348:84 , srv2141205417:84 , srv277249358:84 , srv285975344:84 , srv300208466:84 , srv315286551:84 , srv344438942:84 , srv405826366:84 , srv416133970:84 , srv425561870:84 , srv427560613:84 , srv442465854:84 , srv455613204:84 , srv458659867:84 , srv478920468:84 , srv484121909:84 , srv510735679:84 , srv527709574:84 , srv530585669:84 , srv531862305:84 , srv53959859:84 , srv541519002:84 , srv549584628:84 , srv578359598:84 , srv607439968:84 , srv655296075:84 , srv685818440:84 , srv706367837:84 , srv726791160:84 , srv773476046:84 , srv777935509:84 , srv779169273:84 , srv814012120:84 , srv817663947:84 , srv820340295:84 , srv84499464:84 , srv85178640:84 , srv888620361:84 , srv928607152:84 , srv952389534:84 , srv953872278:84 , srv1768334590:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-08 07:54:14,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:14,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:14,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:14,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:14,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:14,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:14,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:14,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:14,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:14,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:14,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:14,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:14,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:14,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:14,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:14,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:14,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:14,662 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 07:54:14,662 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 07:54:14,969 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 460 ms to try 5000 different iterations.  Found a solution that moves 4682 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1827740936543817. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03870616041048775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056963965611838425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5202222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03870616041048775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:14,983 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv777935509:80 , srv1841462103:81 , srv1992731439:81 , srv817663947:81 , srv1934148090:82 , srv1114900148:83 , srv1549626063:83 , srv1689786281:83 , srv1800520280:83 , srv1355190357:84 , srv1747553890:84 , srv1985231426:84 , srv2095818604:84 , srv530585669:84 , srv953872278:84 , srv1133393388:85 , srv1158445949:85 , srv1304434371:85 , srv1329970784:85 , srv1337320114:85 , srv139233958:85 , srv1817192028:85 , srv2045635292:85 , srv2099769856:85 , srv285975344:85 , srv344438942:85 , srv442465854:85 , srv84499464:85 , srv952389534:85 , srv1042312251:86 , srv1089358453:86 , srv1136540653:86 , srv1485693974:86 , srv1512570329:86 , srv1624272012:86 , srv184204744:86 , srv1862401918:86 , srv191116460:86 , srv1955336860:86 , srv2016311300:86 , srv2141205417:86 , srv277249358:86 , srv405826366:86 , srv427560613:86 , srv541519002:86 , srv685818440:86 , srv820340295:86 , srv85178640:86 , srv100758040:87 , srv1145035075:87 , srv1165537795:87 , srv1458639991:87 , srv1485280017:87 , srv1561787415:87 , srv1580901732:87 , srv1621933728:87 , srv1667614916:87 , srv1677559265:87 , srv1859375625:87 , srv1975752884:87 , srv1980235573:87 , srv1989394159:87 , srv315286551:87 , srv425561870:87 , srv478920468:87 , srv484121909:87 , srv53959859:87 , srv549584628:87 , srv578359598:87 , srv655296075:87 , srv706367837:87 , srv726791160:87 , srv779169273:87 , srv1256101868:88 , srv1900079443:88 , srv2018146452:88 , srv455613204:88 , srv458659867:88 , srv527709574:88 , srv531862305:88 , srv773476046:88 , srv888620361:88 , srv928607152:88 , srv1080385346:89 , srv1291491100:89 , srv1437642389:89 , srv1661079740:89 , srv186966301:89 , srv2090007568:89 , srv1208032590:90 , srv1622867143:90 , srv1964083380:90 , srv2121809348:90 , srv300208466:90 , srv510735679:90 , srv607439968:91 , srv1696806034:92 , srv416133970:92 , srv814012120:97 , srv1768334590:434 }
2023-03-08 07:54:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:15,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:15,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:15,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:15,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:15,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:15,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:15,010 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:15,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:15,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:15,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:15,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:15,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:15,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:15,131 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03870616041048775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056963965611838425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03870616041048775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:15,131 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 07:54:15,132 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1827413095896738, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03870616041048775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.056963965611838425, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03870616041048775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17825, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24241666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 07:54:15,419 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 386 ms to try 5000 different iterations.  Found a solution that moves 2669 regions; Going from a computed imbalance of 0.1827413095896738 to a new imbalance of 0.015071297190628644. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035273502484915085, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29655555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:15,429 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv814012120:75 , srv416133970:79 , srv1696806034:80 , srv1964083380:81 , srv2018146452:81 , srv510735679:81 , srv1291491100:82 , srv1622867143:82 , srv186966301:82 , srv1900079443:82 , srv607439968:82 , srv1145035075:83 , srv1859375625:83 , srv2090007568:83 , srv2121809348:83 , srv300208466:83 , srv478920468:83 , srv527709574:83 , srv53959859:83 , srv773476046:83 , srv1080385346:84 , srv1136540653:84 , srv1208032590:84 , srv1437642389:84 , srv1485280017:84 , srv1485693974:84 , srv1621933728:84 , srv1661079740:84 , srv1677559265:84 , srv1975752884:84 , srv1980235573:84 , srv458659867:84 , srv685818440:84 , srv726791160:84 , srv820340295:84 , srv100758040:85 , srv1165537795:85 , srv1256101868:85 , srv315286551:85 , srv425561870:85 , srv531862305:85 , srv541519002:85 , srv578359598:85 , srv655296075:85 , srv1042312251:86 , srv1133393388:86 , srv1158445949:86 , srv1304434371:86 , srv1337320114:86 , srv1458639991:86 , srv1561787415:86 , srv1747553890:86 , srv1800520280:86 , srv1817192028:86 , srv1862401918:86 , srv191116460:86 , srv1955336860:86 , srv1989394159:86 , srv455613204:86 , srv484121909:86 , srv530585669:86 , srv779169273:86 , srv888620361:86 , srv1089358453:87 , srv1329970784:87 , srv139233958:87 , srv1512570329:87 , srv1667614916:87 , srv2045635292:87 , srv2095818604:87 , srv2099769856:87 , srv277249358:87 , srv427560613:87 , srv549584628:87 , srv706367837:87 , srv84499464:87 , srv85178640:87 , srv1580901732:88 , srv1624272012:88 , srv184204744:88 , srv1934148090:88 , srv1985231426:88 , srv2016311300:88 , srv2141205417:88 , srv285975344:88 , srv344438942:88 , srv442465854:88 , srv952389534:88 , srv953872278:88 , srv1114900148:89 , srv1355190357:89 , srv1689786281:89 , srv1992731439:89 , srv817663947:89 , srv928607152:89 , srv1549626063:90 , srv1841462103:90 , srv405826366:91 , srv777935509:91 , srv1768334590:537 }
2023-03-08 07:54:15,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:15,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:15,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:15,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:15,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:15,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:15,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:15,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:15,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:15,572 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035273502484915085, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:15,572 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 07:54:15,572 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015052608453186248, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022171659648805984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035273502484915085, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022171659648805984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045083333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 07:54:15,853 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 379 ms to try 5000 different iterations.  Found a solution that moves 1039 regions; Going from a computed imbalance of 0.015052608453186248 to a new imbalance of 3.878063714376767E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00446404208980198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721965); MoveCostFunction : (multiplier=7.0, imbalance=0.11544444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00446404208980198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:15,857 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv928607152:78 , srv405826366:82 , srv1580901732:83 , srv184204744:83 , srv2016311300:83 , srv1256101868:84 , srv1355190357:84 , srv1437642389:84 , srv1458639991:84 , srv1624272012:84 , srv1661079740:84 , srv1667614916:84 , srv1989394159:84 , srv2141205417:84 , srv277249358:84 , srv285975344:84 , srv531862305:84 , srv549584628:84 , srv607439968:84 , srv779169273:84 , srv85178640:84 , srv888620361:84 , srv100758040:85 , srv1042312251:85 , srv1080385346:85 , srv1208032590:85 , srv1329970784:85 , srv139233958:85 , srv1512570329:85 , srv1549626063:85 , srv1561787415:85 , srv1689786281:85 , srv1696806034:85 , srv1862401918:85 , srv2099769856:85 , srv2121809348:85 , srv300208466:85 , srv344438942:85 , srv442465854:85 , srv455613204:85 , srv458659867:85 , srv484121909:85 , srv578359598:85 , srv655296075:85 , srv706367837:85 , srv777935509:85 , srv814012120:85 , srv84499464:85 , srv952389534:85 , srv953872278:85 , srv1089358453:86 , srv1114900148:86 , srv1165537795:86 , srv1304434371:86 , srv1337320114:86 , srv1622867143:86 , srv1677559265:86 , srv1817192028:86 , srv191116460:86 , srv1975752884:86 , srv1980235573:86 , srv1985231426:86 , srv2045635292:86 , srv2090007568:86 , srv315286551:86 , srv425561870:86 , srv427560613:86 , srv510735679:86 , srv53959859:86 , srv541519002:86 , srv726791160:86 , srv1133393388:87 , srv1145035075:87 , srv1158445949:87 , srv1291491100:87 , srv1485280017:87 , srv1485693974:87 , srv1621933728:87 , srv186966301:87 , srv1900079443:87 , srv1955336860:87 , srv1992731439:87 , srv416133970:87 , srv478920468:87 , srv527709574:87 , srv773476046:87 , srv817663947:87 , srv820340295:87 , srv1136540653:88 , srv1800520280:88 , srv1859375625:88 , srv1934148090:88 , srv1964083380:88 , srv2095818604:88 , srv530585669:88 , srv685818440:88 , srv1747553890:89 , srv1841462103:89 , srv2018146452:90 , srv1768334590:526 }
2023-03-08 07:54:15,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:15,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:15,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:15,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:15,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:15,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:15,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:15,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:15,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:15,988 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00446404208980198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721965); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00446404208980198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:15,988 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 07:54:15,989 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.8053113794099324E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00446404208980198); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006426656048721965); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00446404208980198); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0036666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 07:54:16,370 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 480 ms to try 5000 different iterations.  Found a solution that moves 231 regions; Going from a computed imbalance of 3.8053113794099324E-4 to a new imbalance of 2.9030558557596078E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.025666666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:16,371 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1841462103:82 , srv455613204:82 , srv1089358453:83 , srv1114900148:83 , srv1208032590:83 , srv1955336860:83 , srv1964083380:83 , srv2018146452:83 , srv2095818604:83 , srv2121809348:83 , srv405826366:83 , srv427560613:83 , srv706367837:83 , srv1080385346:84 , srv1133393388:84 , srv1158445949:84 , srv1165537795:84 , srv1256101868:84 , srv1291491100:84 , srv1337320114:84 , srv1485280017:84 , srv1512570329:84 , srv1549626063:84 , srv1561787415:84 , srv1580901732:84 , srv1621933728:84 , srv1622867143:84 , srv1624272012:84 , srv1667614916:84 , srv1747553890:84 , srv1859375625:84 , srv186966301:84 , srv191116460:84 , srv1934148090:84 , srv1985231426:84 , srv1989394159:84 , srv2045635292:84 , srv2090007568:84 , srv2141205417:84 , srv300208466:84 , srv315286551:84 , srv344438942:84 , srv416133970:84 , srv442465854:84 , srv458659867:84 , srv484121909:84 , srv527709574:84 , srv530585669:84 , srv549584628:84 , srv726791160:84 , srv773476046:84 , srv779169273:84 , srv85178640:84 , srv888620361:84 , srv952389534:84 , srv100758040:85 , srv1042312251:85 , srv1136540653:85 , srv1145035075:85 , srv1329970784:85 , srv1355190357:85 , srv139233958:85 , srv1437642389:85 , srv1458639991:85 , srv1485693974:85 , srv1661079740:85 , srv1677559265:85 , srv1689786281:85 , srv1696806034:85 , srv1817192028:85 , srv184204744:85 , srv1862401918:85 , srv1900079443:85 , srv1975752884:85 , srv1980235573:85 , srv1992731439:85 , srv2016311300:85 , srv2099769856:85 , srv277249358:85 , srv425561870:85 , srv478920468:85 , srv510735679:85 , srv531862305:85 , srv578359598:85 , srv607439968:85 , srv685818440:85 , srv814012120:85 , srv817663947:85 , srv820340295:85 , srv953872278:85 , srv1304434371:86 , srv1800520280:86 , srv285975344:86 , srv53959859:86 , srv541519002:86 , srv655296075:86 , srv777935509:86 , srv84499464:86 , srv928607152:87 , srv1768334590:645 }
2023-03-08 07:54:16,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:16,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:16,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:16,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:16,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:16,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:16,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:16,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:16,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:16,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:16,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:16,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:16,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:16,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:16,506 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 07:54:16,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7413061986148646E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0022222222222222222); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 07:54:16,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 323 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 2.7413061986148646E-5 to a new imbalance of 6.657065209687686E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:16,737 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1136540653:83 , srv1304434371:83 , srv1747553890:83 , srv1800520280:83 , srv285975344:83 , srv425561870:83 , srv541519002:83 , srv655296075:83 , srv685818440:83 , srv84499464:83 , srv100758040:84 , srv1042312251:84 , srv1080385346:84 , srv1089358453:84 , srv1133393388:84 , srv1145035075:84 , srv1158445949:84 , srv1165537795:84 , srv1208032590:84 , srv1291491100:84 , srv1329970784:84 , srv1355190357:84 , srv139233958:84 , srv1437642389:84 , srv1458639991:84 , srv1485280017:84 , srv1485693974:84 , srv1512570329:84 , srv1549626063:84 , srv1561787415:84 , srv1580901732:84 , srv1621933728:84 , srv1622867143:84 , srv1624272012:84 , srv1661079740:84 , srv1667614916:84 , srv1677559265:84 , srv1689786281:84 , srv1696806034:84 , srv1817192028:84 , srv1841462103:84 , srv184204744:84 , srv1859375625:84 , srv1862401918:84 , srv186966301:84 , srv1900079443:84 , srv191116460:84 , srv1934148090:84 , srv1955336860:84 , srv1964083380:84 , srv1975752884:84 , srv1980235573:84 , srv1985231426:84 , srv1992731439:84 , srv2016311300:84 , srv2018146452:84 , srv2045635292:84 , srv2090007568:84 , srv2095818604:84 , srv2099769856:84 , srv2141205417:84 , srv277249358:84 , srv300208466:84 , srv315286551:84 , srv344438942:84 , srv405826366:84 , srv416133970:84 , srv427560613:84 , srv442465854:84 , srv478920468:84 , srv484121909:84 , srv510735679:84 , srv527709574:84 , srv530585669:84 , srv531862305:84 , srv53959859:84 , srv549584628:84 , srv578359598:84 , srv607439968:84 , srv706367837:84 , srv773476046:84 , srv777935509:84 , srv814012120:84 , srv817663947:84 , srv820340295:84 , srv888620361:84 , srv928607152:84 , srv952389534:84 , srv953872278:84 , srv1114900148:85 , srv1256101868:85 , srv1337320114:85 , srv1989394159:85 , srv2121809348:85 , srv455613204:85 , srv458659867:85 , srv726791160:85 , srv779169273:85 , srv85178640:85 , srv1768334590:684 }
2023-03-08 07:54:16,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:16,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1661079740=29, srv455613204=71, srv953872278=99, srv549584628=81, srv1622867143=27, srv1621933728=26, srv425561870=68, srv484121909=74, srv2099769856=58, srv1841462103=38, srv405826366=66, srv1080385346=2, srv1355190357=16, srv2095818604=57, srv531862305=78, srv285975344=62, srv1485693974=21, srv184204744=39, srv427560613=69, srv527709574=76, srv2018146452=54, srv315286551=64, srv1042312251=1, srv1089358453=3, srv814012120=91, srv1304434371=13, srv1549626063=23, srv530585669=77, srv1208032590=10, srv1458639991=19, srv1934148090=45, srv458659867=72, srv1158445949=8, srv1256101868=11, srv1677559265=31, srv655296075=84, srv779169273=90, srv541519002=80, srv1291491100=12, srv928607152=97, srv1114900148=4, srv186966301=42, srv1329970784=14, srv1859375625=40, srv685818440=85, srv1165537795=9, srv191116460=44, srv300208466=63, srv607439968=83, srv277249358=61, srv1989394159=51, srv1145035075=7, srv706367837=86, srv344438942=65, srv478920468=73, srv2121809348=59, srv578359598=82, srv1696806034=33, srv510735679=75, srv1747553890=34, srv1862401918=41, srv100758040=0, srv1768334590=35, srv139233958=17, srv1437642389=18, srv1955336860=46, srv1980235573=49, srv1485280017=20, srv1337320114=15, srv1667614916=30, srv2141205417=60, srv1975752884=48, srv820340295=93, srv888620361=96, srv1561787415=24, srv1624272012=28, srv817663947=92, srv1512570329=22, srv2016311300=53, srv1985231426=50, srv1992731439=52, srv1900079443=43, srv1689786281=32, srv1800520280=36, srv1817192028=37, srv1136540653=6, srv1580901732=25, srv952389534=98, srv2045635292=55, srv84499464=94, srv2090007568=56, srv416133970=67, srv726791160=87, srv85178640=95, srv53959859=79, srv777935509=89, srv773476046=88, srv442465854=70, srv1133393388=5, srv1964083380=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:16,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:16,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 07:54:16,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 07:54:16,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 07:54:16,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 07:54:16,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 07:54:16,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 07:54:16,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:16,860 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1136540653:83 , srv1304434371:83 , srv1747553890:83 , srv1800520280:83 , srv285975344:83 , srv425561870:83 , srv541519002:83 , srv655296075:83 , srv685818440:83 , srv84499464:83 , srv100758040:84 , srv1042312251:84 , srv1080385346:84 , srv1089358453:84 , srv1133393388:84 , srv1145035075:84 , srv1158445949:84 , srv1165537795:84 , srv1208032590:84 , srv1291491100:84 , srv1329970784:84 , srv1355190357:84 , srv139233958:84 , srv1437642389:84 , srv1458639991:84 , srv1485280017:84 , srv1485693974:84 , srv1512570329:84 , srv1549626063:84 , srv1561787415:84 , srv1580901732:84 , srv1621933728:84 , srv1622867143:84 , srv1624272012:84 , srv1661079740:84 , srv1667614916:84 , srv1677559265:84 , srv1689786281:84 , srv1696806034:84 , srv1817192028:84 , srv1841462103:84 , srv184204744:84 , srv1859375625:84 , srv1862401918:84 , srv186966301:84 , srv1900079443:84 , srv191116460:84 , srv1934148090:84 , srv1955336860:84 , srv1964083380:84 , srv1975752884:84 , srv1980235573:84 , srv1985231426:84 , srv1992731439:84 , srv2016311300:84 , srv2018146452:84 , srv2045635292:84 , srv2090007568:84 , srv2095818604:84 , srv2099769856:84 , srv2141205417:84 , srv277249358:84 , srv300208466:84 , srv315286551:84 , srv344438942:84 , srv405826366:84 , srv416133970:84 , srv427560613:84 , srv442465854:84 , srv478920468:84 , srv484121909:84 , srv510735679:84 , srv527709574:84 , srv530585669:84 , srv531862305:84 , srv53959859:84 , srv549584628:84 , srv578359598:84 , srv607439968:84 , srv706367837:84 , srv773476046:84 , srv777935509:84 , srv814012120:84 , srv817663947:84 , srv820340295:84 , srv888620361:84 , srv928607152:84 , srv952389534:84 , srv953872278:84 , srv1114900148:85 , srv1256101868:85 , srv1337320114:85 , srv1989394159:85 , srv2121809348:85 , srv455613204:85 , srv458659867:85 , srv726791160:85 , srv779169273:85 , srv85178640:85 , srv1768334590:684 }
2023-03-08 07:54:16,884 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 301), ProcessCount=170 (was 172), AvailableMemoryMB=7738 (was 8221)
2023-03-08 07:54:16,891 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=170, AvailableMemoryMB=7737
2023-03-08 07:54:16,892 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 07:54:16,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-08 07:54:16,901 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048544002:84 , srv1196232566:84 , srv1258181956:84 , srv1262383019:84 , srv1281279614:84 , srv1346309519:84 , srv1389247847:84 , srv1418448863:84 , srv1430511281:84 , srv1556863127:84 , srv1560244222:84 , srv1595053301:84 , srv169763667:84 , srv1803229414:84 , srv1874702843:84 , srv1978607871:84 , srv2031954948:84 , srv2032078160:84 , srv2075455370:84 , srv2081085880:84 , srv243818269:84 , srv29704976:84 , srv302178965:84 , srv30885222:84 , srv43908991:84 , srv538164556:84 , srv597517852:84 , srv730206366:84 , srv910792395:84 , srv777221230:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-08 07:54:16,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:54:16,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1281279614=4, srv243818269=20, srv1262383019=3, srv1595053301=11, srv777221230=28, srv302178965=22, srv1196232566=1, srv2075455370=18, srv910792395=29, srv597517852=26, srv1560244222=10, srv1346309519=5, srv538164556=25, srv1389247847=6, srv2032078160=17, srv169763667=12, srv2081085880=19, srv29704976=21, srv30885222=23, srv730206366=27, srv1048544002=0, srv1803229414=13, srv1430511281=8, srv1556863127=9, srv1258181956=2, srv1978607871=15, srv2031954948=16, srv1874702843=14, srv1418448863=7, srv43908991=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:54:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:54:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:54:16,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 07:54:16,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152338471363654, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:54:16,928 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912556141353875, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1152338471363654, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-08 07:56:16,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6017194 different iterations.  Found a solution that moves 1852 regions; Going from a computed imbalance of 0.9912556141353875 to a new imbalance of 4.322660390073086E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6859259259259259, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:56:16,925 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1048544002:90 , srv1196232566:90 , srv1258181956:90 , srv1262383019:90 , srv1281279614:90 , srv1346309519:90 , srv1389247847:90 , srv1418448863:90 , srv1430511281:90 , srv1556863127:90 , srv1560244222:90 , srv1595053301:90 , srv169763667:90 , srv1803229414:90 , srv1874702843:90 , srv1978607871:90 , srv2031954948:90 , srv2032078160:90 , srv2075455370:90 , srv2081085880:90 , srv243818269:90 , srv29704976:90 , srv302178965:90 , srv30885222:90 , srv43908991:90 , srv538164556:90 , srv597517852:90 , srv730206366:90 , srv777221230:90 , srv910792395:90 }
2023-03-08 07:56:16,926 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 07:56:16,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1281279614=4, srv243818269=20, srv1262383019=3, srv1595053301=11, srv777221230=28, srv302178965=22, srv1196232566=1, srv2075455370=18, srv910792395=29, srv597517852=26, srv1560244222=10, srv1346309519=5, srv538164556=25, srv1389247847=6, srv2032078160=17, srv169763667=12, srv2081085880=19, srv29704976=21, srv30885222=23, srv730206366=27, srv1048544002=0, srv1803229414=13, srv1430511281=8, srv1556863127=9, srv1258181956=2, srv1978607871=15, srv2031954948=16, srv1874702843=14, srv1418448863=7, srv43908991=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 07:56:16,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 07:56:16,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 07:56:16,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 07:56:16,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 07:56:16,946 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1048544002:90 , srv1196232566:90 , srv1258181956:90 , srv1262383019:90 , srv1281279614:90 , srv1346309519:90 , srv1389247847:90 , srv1418448863:90 , srv1430511281:90 , srv1556863127:90 , srv1560244222:90 , srv1595053301:90 , srv169763667:90 , srv1803229414:90 , srv1874702843:90 , srv1978607871:90 , srv2031954948:90 , srv2032078160:90 , srv2075455370:90 , srv2081085880:90 , srv243818269:90 , srv29704976:90 , srv302178965:90 , srv30885222:90 , srv43908991:90 , srv538164556:90 , srv597517852:90 , srv730206366:90 , srv777221230:90 , srv910792395:90 }
2023-03-08 07:56:16,958 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 301), ProcessCount=170 (was 170), AvailableMemoryMB=7424 (was 7737)