2023-03-03 15:56:55,104 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-03 15:56:55,429 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-03 15:56:55,522 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-03 15:56:55,573 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 15:56:55,580 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 15:56:55,594 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=339, ProcessCount=165, AvailableMemoryMB=9462
2023-03-03 15:56:55,596 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 15:56:55,597 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-03 15:56:55,751 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019778054:84 , srv1034196537:84 , srv1141688759:84 , srv1158072157:84 , srv1160900032:84 , srv1178626882:84 , srv1206103637:84 , srv1218662917:84 , srv1273875056:84 , srv1273943303:84 , srv1298055478:84 , srv1364161768:84 , srv1368082093:84 , srv1378566108:84 , srv1381809228:84 , srv1386870271:84 , srv1395108675:84 , srv1401462179:84 , srv140667337:84 , srv1415625728:84 , srv1439411724:84 , srv1458369746:84 , srv1494151677:84 , srv1530898815:84 , srv1542815491:84 , srv1542972070:84 , srv1566070165:84 , srv1598981195:84 , srv1613364142:84 , srv162968795:84 , srv1641272349:84 , srv1660107361:84 , srv1726743561:84 , srv1731565386:84 , srv1731734161:84 , srv1771372758:84 , srv1785432181:84 , srv1800684390:84 , srv1817334503:84 , srv1840864647:84 , srv1862244347:84 , srv1877451249:84 , srv1904421113:84 , srv1907026250:84 , srv1914671690:84 , srv1933121511:84 , srv1959254667:84 , srv1974907856:84 , srv2007375598:84 , srv2024963583:84 , srv2035145517:84 , srv2036891136:84 , srv2038495402:84 , srv2048029555:84 , srv2091921318:84 , srv2113404360:84 , srv2130369502:84 , srv234793690:84 , srv322097197:84 , srv342522061:84 , srv3612495:84 , srv405193215:84 , srv423047220:84 , srv427338580:84 , srv476096253:84 , srv47784897:84 , srv479381939:84 , srv566008386:84 , srv573018799:84 , srv591635251:84 , srv617166603:84 , srv621976854:84 , srv624331022:84 , srv631608579:84 , srv643452623:84 , srv657899870:84 , srv659816543:84 , srv665462325:84 , srv693154614:84 , srv707292810:84 , srv720946936:84 , srv721865565:84 , srv725031543:84 , srv729971843:84 , srv731705262:84 , srv795575032:84 , srv810648552:84 , srv815578841:84 , srv855542972:84 , srv882513012:84 , srv899010252:84 , srv916822194:84 , srv942174057:84 , srv943117133:84 , srv961060659:84 , srv970436734:84 , srv976910695:84 , srv980426712:84 , srv991150584:84 , srv1352875533:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-03 15:56:55,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:55,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:55,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:55,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:55,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:55,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:55,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:55,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:55,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:55,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:55,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:55,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:55,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:55,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:55,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:56,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:56,108 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 15:56:56,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 15:56:56,481 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 596 ms to try 5000 different iterations.  Found a solution that moves 4653 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18695372536823418. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983974632456119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05765137688741345, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.517, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983974632456119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18241666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:56,499 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1141688759:81 , srv980426712:81 , srv1415625728:82 , srv1660107361:82 , srv1974907856:82 , srv2048029555:82 , srv234793690:82 , srv624331022:82 , srv707292810:82 , srv729971843:82 , srv1206103637:83 , srv2036891136:83 , srv621976854:83 , srv815578841:83 , srv976910695:83 , srv1530898815:84 , srv1613364142:84 , srv2038495402:84 , srv3612495:84 , srv479381939:84 , srv566008386:84 , srv573018799:84 , srv657899870:84 , srv1395108675:85 , srv1401462179:85 , srv1726743561:85 , srv1914671690:85 , srv1933121511:85 , srv2130369502:85 , srv617166603:85 , srv665462325:85 , srv855542972:85 , srv882513012:85 , srv942174057:85 , srv943117133:85 , srv991150584:85 , srv1019778054:86 , srv1178626882:86 , srv1273875056:86 , srv1273943303:86 , srv1364161768:86 , srv1542972070:86 , srv1566070165:86 , srv1800684390:86 , srv1904421113:86 , srv1907026250:86 , srv591635251:86 , srv720946936:86 , srv899010252:86 , srv1034196537:87 , srv1378566108:87 , srv1439411724:87 , srv1542815491:87 , srv1641272349:87 , srv1731565386:87 , srv1785432181:87 , srv1840864647:87 , srv2007375598:87 , srv2024963583:87 , srv322097197:87 , srv405193215:87 , srv476096253:87 , srv47784897:87 , srv721865565:87 , srv970436734:87 , srv1218662917:88 , srv1368082093:88 , srv140667337:88 , srv1458369746:88 , srv1494151677:88 , srv2035145517:88 , srv2091921318:88 , srv423047220:88 , srv643452623:88 , srv725031543:88 , srv731705262:88 , srv961060659:88 , srv1158072157:89 , srv1298055478:89 , srv1381809228:89 , srv1386870271:89 , srv1598981195:89 , srv162968795:89 , srv1731734161:89 , srv1817334503:89 , srv1862244347:89 , srv810648552:89 , srv1959254667:90 , srv342522061:90 , srv427338580:90 , srv631608579:90 , srv659816543:90 , srv795575032:90 , srv1771372758:91 , srv1877451249:91 , srv2113404360:91 , srv1160900032:92 , srv693154614:92 , srv916822194:93 , srv1352875533:444 }
2023-03-03 15:56:56,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:56,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:56,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:56,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:56,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:56,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:56,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:56,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:56,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:56,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:56,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:56,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:56,534 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:56,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:56,536 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:56,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:56,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:56,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:56,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:56,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:56,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:56,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:56,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983974632456119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05765137688741345, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983974632456119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18241666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:56,707 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 15:56:56,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18692114436586643, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03983974632456119, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05765137688741345, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03983974632456119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18241666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24708333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 15:56:56,952 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 384 ms to try 5000 different iterations.  Found a solution that moves 2674 regions; Going from a computed imbalance of 0.18692114436586643 to a new imbalance of 0.014333583153893964. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02295970434139603); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220305943597653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2971111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02295970434139603); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:56,964 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1160900032:79 , srv1877451249:80 , srv916822194:80 , srv162968795:81 , srv1959254667:81 , srv693154614:81 , srv1034196537:82 , srv1158072157:82 , srv1598981195:82 , srv1641272349:82 , srv1862244347:82 , srv2113404360:82 , srv725031543:82 , srv795575032:82 , srv1178626882:83 , srv1218662917:83 , srv1298055478:83 , srv1368082093:83 , srv1378566108:83 , srv1494151677:83 , srv2024963583:83 , srv2035145517:83 , srv342522061:83 , srv423047220:83 , srv427338580:83 , srv721865565:83 , srv731705262:83 , srv810648552:83 , srv1386870271:84 , srv1401462179:84 , srv1458369746:84 , srv1785432181:84 , srv1800684390:84 , srv1817334503:84 , srv2091921318:84 , srv476096253:84 , srv631608579:84 , srv643452623:84 , srv899010252:84 , srv1439411724:85 , srv1542815491:85 , srv1542972070:85 , srv1731565386:85 , srv1731734161:85 , srv1771372758:85 , srv1840864647:85 , srv1904421113:85 , srv1914671690:85 , srv3612495:85 , srv405193215:85 , srv47784897:85 , srv720946936:85 , srv961060659:85 , srv1273875056:86 , srv1273943303:86 , srv1364161768:86 , srv1381809228:86 , srv140667337:86 , srv1907026250:86 , srv2038495402:86 , srv322097197:86 , srv591635251:86 , srv659816543:86 , srv970436734:86 , srv1206103637:87 , srv1566070165:87 , srv1613364142:87 , srv1726743561:87 , srv2130369502:87 , srv573018799:87 , srv943117133:87 , srv1933121511:88 , srv2007375598:88 , srv566008386:88 , srv617166603:88 , srv657899870:88 , srv665462325:88 , srv707292810:88 , srv815578841:88 , srv855542972:88 , srv882513012:88 , srv976910695:88 , srv991150584:88 , srv1395108675:89 , srv1974907856:89 , srv2036891136:89 , srv729971843:89 , srv942174057:89 , srv1019778054:90 , srv1141688759:90 , srv1530898815:90 , srv2048029555:90 , srv479381939:90 , srv621976854:90 , srv624331022:90 , srv1660107361:91 , srv234793690:91 , srv980426712:91 , srv1415625728:93 , srv1352875533:534 }
2023-03-03 15:56:56,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:56,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:56,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:56,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:56,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:56,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:56,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:56,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:56,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:56,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:56,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:56,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:57,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:57,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:57,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02295970434139603); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220305943597653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02295970434139603); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:57,122 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 15:56:57,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014314859405703269, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02295970434139603); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03220305943597653, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02295970434139603); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042833333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 15:56:57,329 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 308 ms to try 5000 different iterations.  Found a solution that moves 975 regions; Going from a computed imbalance of 0.014314859405703269 to a new imbalance of 6.96265916634071E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071084450670123355); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.10833333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0071084450670123355); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:57,330 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1019778054:81 , srv1771372758:81 , srv659816543:81 , srv1415625728:82 , srv2007375598:82 , srv1395108675:83 , srv140667337:83 , srv234793690:83 , srv631608579:83 , srv693154614:83 , srv1364161768:84 , srv1381809228:84 , srv1530898815:84 , srv1566070165:84 , srv1731734161:84 , srv1817334503:84 , srv2113404360:84 , srv342522061:84 , srv427338580:84 , srv479381939:84 , srv617166603:84 , srv621976854:84 , srv882513012:84 , srv916822194:84 , srv942174057:84 , srv970436734:84 , srv980426712:84 , srv991150584:84 , srv1273875056:85 , srv1298055478:85 , srv1386870271:85 , srv1439411724:85 , srv1458369746:85 , srv1542815491:85 , srv1660107361:85 , srv1726743561:85 , srv1840864647:85 , srv1907026250:85 , srv1933121511:85 , srv2091921318:85 , srv2130369502:85 , srv322097197:85 , srv405193215:85 , srv47784897:85 , srv624331022:85 , srv643452623:85 , srv657899870:85 , srv665462325:85 , srv795575032:85 , srv855542972:85 , srv961060659:85 , srv1141688759:86 , srv1218662917:86 , srv1273943303:86 , srv1368082093:86 , srv1494151677:86 , srv1598981195:86 , srv1613364142:86 , srv1785432181:86 , srv1904421113:86 , srv1959254667:86 , srv1974907856:86 , srv2035145517:86 , srv2036891136:86 , srv2038495402:86 , srv2048029555:86 , srv566008386:86 , srv731705262:86 , srv810648552:86 , srv815578841:86 , srv943117133:86 , srv1158072157:87 , srv1160900032:87 , srv1378566108:87 , srv1542972070:87 , srv162968795:87 , srv1731565386:87 , srv1862244347:87 , srv1877451249:87 , srv1914671690:87 , srv2024963583:87 , srv423047220:87 , srv476096253:87 , srv573018799:87 , srv591635251:87 , srv707292810:87 , srv720946936:87 , srv729971843:87 , srv899010252:87 , srv976910695:87 , srv1034196537:88 , srv1178626882:88 , srv1206103637:88 , srv1641272349:88 , srv3612495:88 , srv721865565:88 , srv1401462179:89 , srv1800684390:89 , srv725031543:89 , srv1352875533:543 }
2023-03-03 15:56:57,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:57,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:57,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:57,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:57,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:57,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:57,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:57,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:57,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:57,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:57,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:57,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:57,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:57,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:57,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:57,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:57,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:57,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:57,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:57,462 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071084450670123355); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0071084450670123355); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:57,463 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 15:56:57,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.894388207156242E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071084450670123355); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008888888888888889); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0071084450670123355); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 15:56:57,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 397 ms to try 5000 different iterations.  Found a solution that moves 267 regions; Going from a computed imbalance of 6.894388207156242E-4 to a new imbalance of 3.362744400279479E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.029666666666666668, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:57,765 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1381809228:83 , srv1731565386:83 , srv1800684390:83 , srv591635251:83 , srv725031543:83 , srv943117133:83 , srv1141688759:84 , srv1158072157:84 , srv1160900032:84 , srv1273943303:84 , srv1368082093:84 , srv1386870271:84 , srv1401462179:84 , srv140667337:84 , srv1542972070:84 , srv1660107361:84 , srv1731734161:84 , srv1862244347:84 , srv1877451249:84 , srv1907026250:84 , srv1933121511:84 , srv322097197:84 , srv423047220:84 , srv476096253:84 , srv479381939:84 , srv566008386:84 , srv573018799:84 , srv665462325:84 , srv720946936:84 , srv721865565:84 , srv729971843:84 , srv810648552:84 , srv855542972:84 , srv942174057:84 , srv961060659:84 , srv976910695:84 , srv1019778054:85 , srv1034196537:85 , srv1178626882:85 , srv1206103637:85 , srv1218662917:85 , srv1273875056:85 , srv1298055478:85 , srv1395108675:85 , srv1415625728:85 , srv1439411724:85 , srv1458369746:85 , srv1494151677:85 , srv1530898815:85 , srv1542815491:85 , srv1566070165:85 , srv1598981195:85 , srv1613364142:85 , srv162968795:85 , srv1641272349:85 , srv1726743561:85 , srv1771372758:85 , srv1785432181:85 , srv1817334503:85 , srv1840864647:85 , srv1904421113:85 , srv1914671690:85 , srv1959254667:85 , srv1974907856:85 , srv2007375598:85 , srv2024963583:85 , srv2035145517:85 , srv2036891136:85 , srv2038495402:85 , srv2048029555:85 , srv2091921318:85 , srv2113404360:85 , srv2130369502:85 , srv342522061:85 , srv3612495:85 , srv405193215:85 , srv427338580:85 , srv47784897:85 , srv617166603:85 , srv621976854:85 , srv624331022:85 , srv631608579:85 , srv643452623:85 , srv657899870:85 , srv659816543:85 , srv707292810:85 , srv731705262:85 , srv795575032:85 , srv815578841:85 , srv882513012:85 , srv899010252:85 , srv970436734:85 , srv991150584:85 , srv1364161768:86 , srv1378566108:86 , srv234793690:86 , srv693154614:86 , srv916822194:86 , srv980426712:86 , srv1352875533:621 }
2023-03-03 15:56:57,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:57,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:57,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:57,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:57,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:57,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:57,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:57,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:57,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:57,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:57,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:57,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:57,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:57,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:57,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:57,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:57,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:57,911 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:57,912 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-03 15:56:57,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.175787004358931E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-03 15:56:58,085 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 275 ms to try 5000 different iterations.  Found a solution that moves 24 regions; Going from a computed imbalance of 3.175787004358931E-5 to a new imbalance of 5.391985018071482E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.0026666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:58,086 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1206103637:83 , srv1378566108:83 , srv1530898815:83 , srv2036891136:83 , srv2048029555:83 , srv916822194:83 , srv1019778054:84 , srv1034196537:84 , srv1158072157:84 , srv1160900032:84 , srv1178626882:84 , srv1218662917:84 , srv1273875056:84 , srv1273943303:84 , srv1298055478:84 , srv1364161768:84 , srv1381809228:84 , srv1386870271:84 , srv1395108675:84 , srv1401462179:84 , srv1415625728:84 , srv1439411724:84 , srv1458369746:84 , srv1494151677:84 , srv1542815491:84 , srv1542972070:84 , srv1566070165:84 , srv1598981195:84 , srv1613364142:84 , srv162968795:84 , srv1641272349:84 , srv1660107361:84 , srv1726743561:84 , srv1731565386:84 , srv1731734161:84 , srv1771372758:84 , srv1785432181:84 , srv1800684390:84 , srv1817334503:84 , srv1840864647:84 , srv1862244347:84 , srv1877451249:84 , srv1904421113:84 , srv1914671690:84 , srv1933121511:84 , srv1959254667:84 , srv1974907856:84 , srv2007375598:84 , srv2024963583:84 , srv2035145517:84 , srv2091921318:84 , srv2113404360:84 , srv2130369502:84 , srv234793690:84 , srv322097197:84 , srv342522061:84 , srv3612495:84 , srv405193215:84 , srv423047220:84 , srv427338580:84 , srv476096253:84 , srv47784897:84 , srv479381939:84 , srv566008386:84 , srv573018799:84 , srv591635251:84 , srv617166603:84 , srv621976854:84 , srv624331022:84 , srv631608579:84 , srv643452623:84 , srv657899870:84 , srv659816543:84 , srv665462325:84 , srv693154614:84 , srv707292810:84 , srv720946936:84 , srv721865565:84 , srv725031543:84 , srv729971843:84 , srv731705262:84 , srv795575032:84 , srv810648552:84 , srv815578841:84 , srv855542972:84 , srv882513012:84 , srv899010252:84 , srv942174057:84 , srv961060659:84 , srv970436734:84 , srv976910695:84 , srv980426712:84 , srv991150584:84 , srv1141688759:85 , srv1368082093:85 , srv140667337:85 , srv1907026250:85 , srv2038495402:85 , srv943117133:85 , srv1352875533:684 }
2023-03-03 15:56:58,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:58,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv617166603=71, srv47784897=66, srv1401462179=18, srv2024963583=50, srv1141688759=2, srv1381809228=15, srv1904421113=43, srv1386870271=16, srv1660107361=32, srv657899870=76, srv140667337=19, srv2091921318=55, srv1178626882=5, srv2007375598=49, srv3612495=61, srv1034196537=1, srv621976854=72, srv1298055478=10, srv573018799=69, srv942174057=93, srv1395108675=17, srv720946936=81, srv2113404360=56, srv1817334503=39, srv2036891136=52, srv1877451249=42, srv1907026250=44, srv1542815491=25, srv322097197=59, srv855542972=89, srv1019778054=0, srv2035145517=51, srv1959254667=47, srv405193215=62, srv899010252=91, srv427338580=64, srv1613364142=29, srv1206103637=6, srv566008386=68, srv1273943303=9, srv1933121511=46, srv624331022=73, srv1641272349=31, srv1368082093=13, srv1771372758=36, srv665462325=78, srv1974907856=48, srv980426712=98, srv591635251=70, srv795575032=86, srv961060659=95, srv991150584=99, srv659816543=77, srv693154614=79, srv1566070165=27, srv1273875056=8, srv631608579=74, srv721865565=82, srv1598981195=28, srv882513012=90, srv1785432181=37, srv643452623=75, srv1364161768=12, srv162968795=30, srv815578841=88, srv1840864647=40, srv1458369746=22, srv342522061=60, srv1914671690=45, srv1160900032=4, srv1415625728=20, srv1862244347=41, srv1542972070=26, srv2038495402=53, srv810648552=87, srv976910695=97, srv1494151677=23, srv731705262=85, srv234793690=58, srv1378566108=14, srv479381939=67, srv916822194=92, srv1218662917=7, srv2048029555=54, srv1731734161=35, srv1439411724=21, srv2130369502=57, srv1352875533=11, srv1726743561=33, srv476096253=65, srv423047220=63, srv1800684390=38, srv1731565386=34, srv1158072157=3, srv725031543=83, srv1530898815=24, srv970436734=96, srv729971843=84, srv943117133=94, srv707292810=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:58,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:58,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:58,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-03 15:56:58,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-03 15:56:58,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-03 15:56:58,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-03 15:56:58,107 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-03 15:56:58,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-03 15:56:58,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.223933426232788E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:58,202 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1206103637:83 , srv1378566108:83 , srv1530898815:83 , srv2036891136:83 , srv2048029555:83 , srv916822194:83 , srv1019778054:84 , srv1034196537:84 , srv1158072157:84 , srv1160900032:84 , srv1178626882:84 , srv1218662917:84 , srv1273875056:84 , srv1273943303:84 , srv1298055478:84 , srv1364161768:84 , srv1381809228:84 , srv1386870271:84 , srv1395108675:84 , srv1401462179:84 , srv1415625728:84 , srv1439411724:84 , srv1458369746:84 , srv1494151677:84 , srv1542815491:84 , srv1542972070:84 , srv1566070165:84 , srv1598981195:84 , srv1613364142:84 , srv162968795:84 , srv1641272349:84 , srv1660107361:84 , srv1726743561:84 , srv1731565386:84 , srv1731734161:84 , srv1771372758:84 , srv1785432181:84 , srv1800684390:84 , srv1817334503:84 , srv1840864647:84 , srv1862244347:84 , srv1877451249:84 , srv1904421113:84 , srv1914671690:84 , srv1933121511:84 , srv1959254667:84 , srv1974907856:84 , srv2007375598:84 , srv2024963583:84 , srv2035145517:84 , srv2091921318:84 , srv2113404360:84 , srv2130369502:84 , srv234793690:84 , srv322097197:84 , srv342522061:84 , srv3612495:84 , srv405193215:84 , srv423047220:84 , srv427338580:84 , srv476096253:84 , srv47784897:84 , srv479381939:84 , srv566008386:84 , srv573018799:84 , srv591635251:84 , srv617166603:84 , srv621976854:84 , srv624331022:84 , srv631608579:84 , srv643452623:84 , srv657899870:84 , srv659816543:84 , srv665462325:84 , srv693154614:84 , srv707292810:84 , srv720946936:84 , srv721865565:84 , srv725031543:84 , srv729971843:84 , srv731705262:84 , srv795575032:84 , srv810648552:84 , srv815578841:84 , srv855542972:84 , srv882513012:84 , srv899010252:84 , srv942174057:84 , srv961060659:84 , srv970436734:84 , srv976910695:84 , srv980426712:84 , srv991150584:84 , srv1141688759:85 , srv1368082093:85 , srv140667337:85 , srv1907026250:85 , srv2038495402:85 , srv943117133:85 , srv1352875533:684 }
2023-03-03 15:56:58,229 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 339) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=8957 (was 9462)
2023-03-03 15:56:58,239 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=165, AvailableMemoryMB=8955
2023-03-03 15:56:58,240 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-03 15:56:58,241 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-03 15:56:58,253 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1063034322:84 , srv1151060269:84 , srv1242407298:84 , srv1373572903:84 , srv1383576789:84 , srv1444404552:84 , srv1500729064:84 , srv1651498735:84 , srv1765463881:84 , srv18246863:84 , srv1839242641:84 , srv1946872066:84 , srv1981197626:84 , srv2019842859:84 , srv2031807535:84 , srv228896181:84 , srv286994552:84 , srv299978618:84 , srv44655695:84 , srv469343197:84 , srv63206975:84 , srv69186464:84 , srv715470577:84 , srv816553212:84 , srv823759731:84 , srv838828662:84 , srv928655250:84 , srv955572691:84 , srv987472019:84 , srv1654628785:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-03 15:56:58,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:56:58,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1373572903=3, srv2031807535=15, srv987472019=29, srv1839242641=11, srv823759731=25, srv1151060269=1, srv955572691=28, srv44655695=19, srv228896181=16, srv299978618=18, srv1651498735=7, srv69186464=22, srv469343197=20, srv838828662=26, srv928655250=27, srv1444404552=5, srv18246863=10, srv1063034322=0, srv1765463881=9, srv2019842859=14, srv1242407298=2, srv1654628785=8, srv816553212=24, srv1946872066=12, srv1981197626=13, srv286994552=17, srv63206975=21, srv1383576789=4, srv715470577=23, srv1500729064=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:56:58,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:56:58,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:56:58,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 15:56:58,286 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.169134991821569, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:56:58,286 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912725982100743, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.169134991821569, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-03 15:58:58,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9434844 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912725982100743 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:58:58,278 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1063034322:90 , srv1151060269:90 , srv1242407298:90 , srv1373572903:90 , srv1383576789:90 , srv1444404552:90 , srv1500729064:90 , srv1651498735:90 , srv1654628785:90 , srv1765463881:90 , srv18246863:90 , srv1839242641:90 , srv1946872066:90 , srv1981197626:90 , srv2019842859:90 , srv2031807535:90 , srv228896181:90 , srv286994552:90 , srv299978618:90 , srv44655695:90 , srv469343197:90 , srv63206975:90 , srv69186464:90 , srv715470577:90 , srv816553212:90 , srv823759731:90 , srv838828662:90 , srv928655250:90 , srv955572691:90 , srv987472019:90 }
2023-03-03 15:58:58,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-03 15:58:58,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1373572903=3, srv2031807535=15, srv987472019=29, srv1839242641=11, srv823759731=25, srv1151060269=1, srv955572691=28, srv44655695=19, srv228896181=16, srv299978618=18, srv1651498735=7, srv69186464=22, srv469343197=20, srv838828662=26, srv928655250=27, srv1444404552=5, srv18246863=10, srv1063034322=0, srv1765463881=9, srv2019842859=14, srv1242407298=2, srv1654628785=8, srv816553212=24, srv1946872066=12, srv1981197626=13, srv286994552=17, srv63206975=21, srv1383576789=4, srv715470577=23, srv1500729064=6} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-03 15:58:58,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-03 15:58:58,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-03 15:58:58,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-03 15:58:58,294 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1063034322:90 , srv1151060269:90 , srv1242407298:90 , srv1373572903:90 , srv1383576789:90 , srv1444404552:90 , srv1500729064:90 , srv1651498735:90 , srv1654628785:90 , srv1765463881:90 , srv18246863:90 , srv1839242641:90 , srv1946872066:90 , srv1981197626:90 , srv2019842859:90 , srv2031807535:90 , srv228896181:90 , srv286994552:90 , srv299978618:90 , srv44655695:90 , srv469343197:90 , srv63206975:90 , srv69186464:90 , srv715470577:90 , srv816553212:90 , srv823759731:90 , srv838828662:90 , srv928655250:90 , srv955572691:90 , srv987472019:90 }
2023-03-03 15:58:58,305 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 376), ProcessCount=164 (was 165), AvailableMemoryMB=8896 (was 8955)