2023-10-05 23:53:25,160 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-05 23:53:25,432 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-05 23:53:25,532 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-05 23:53:25,599 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-05 23:53:25,607 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-05 23:53:25,620 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=171, AvailableMemoryMB=7223
2023-10-05 23:53:25,622 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-05 23:53:25,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-05 23:53:25,752 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1041397131:84 , srv1071927634:84 , srv1106728526:84 , srv1121179730:84 , srv1132221192:84 , srv1137721467:84 , srv117916023:84 , srv118330364:84 , srv118627012:84 , srv1207111361:84 , srv1224516620:84 , srv1261228220:84 , srv1263304672:84 , srv1266547371:84 , srv1288490208:84 , srv1296937873:84 , srv1300002857:84 , srv1313498440:84 , srv1335004688:84 , srv1339803896:84 , srv1348023820:84 , srv1362989230:84 , srv139307826:84 , srv1457655760:84 , srv1511771072:84 , srv1519532610:84 , srv1539278148:84 , srv1561133118:84 , srv159951077:84 , srv1601041451:84 , srv1611571048:84 , srv1624164387:84 , srv1644027317:84 , srv1729161011:84 , srv1729431543:84 , srv1735262094:84 , srv1736956446:84 , srv1737618045:84 , srv174807795:84 , srv1750432516:84 , srv1775628848:84 , srv1826710617:84 , srv18315749:84 , srv1858400378:84 , srv1870344878:84 , srv18876235:84 , srv1960429336:84 , srv1962536225:84 , srv1987180854:84 , srv2034676923:84 , srv2039039567:84 , srv2051300663:84 , srv2077082345:84 , srv2086750432:84 , srv2103810204:84 , srv2112324613:84 , srv2124064669:84 , srv223859658:84 , srv236630375:84 , srv306193564:84 , srv307047240:84 , srv310366257:84 , srv349097665:84 , srv370046694:84 , srv399236599:84 , srv427430356:84 , srv456400778:84 , srv458833273:84 , srv482678262:84 , srv520732234:84 , srv548895437:84 , srv549216374:84 , srv56094483:84 , srv567204571:84 , srv573708371:84 , srv577225599:84 , srv581210532:84 , srv589028594:84 , srv63612478:84 , srv640353412:84 , srv642606883:84 , srv651747195:84 , srv660077977:84 , srv662746774:84 , srv675632116:84 , srv67567968:84 , srv677502965:84 , srv700898909:84 , srv70210989:84 , srv703798266:84 , srv758575738:84 , srv771535226:84 , srv799173418:84 , srv832569240:84 , srv847952077:84 , srv878015410:84 , srv886377692:84 , srv950633917:84 , srv995152450:84 , srv507040996:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-05 23:53:25,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:25,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:25,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:25,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:25,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:25,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:25,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:25,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:25,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:25,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:25,861 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:25,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:25,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:25,864 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:25,865 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:25,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:25,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:25,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:25,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:25,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:25,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:25,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:25,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:25,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:25,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:25,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:26,077 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:26,077 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-05 23:53:26,078 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-05 23:53:26,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 562 ms to try 5000 different iterations.  Found a solution that moves 4719 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1770293181842956. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039486667463145775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05984641772844092, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5243333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039486667463145775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17191666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:26,491 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv18315749:81 , srv159951077:82 , srv1960429336:82 , srv370046694:82 , srv567204571:82 , srv1106728526:83 , srv1132221192:83 , srv1561133118:83 , srv847952077:83 , srv117916023:84 , srv118627012:84 , srv1339803896:84 , srv2124064669:84 , srv310366257:84 , srv427430356:84 , srv63612478:84 , srv677502965:84 , srv700898909:84 , srv995152450:84 , srv1041397131:85 , srv1071927634:85 , srv1121179730:85 , srv118330364:85 , srv1263304672:85 , srv1457655760:85 , srv1601041451:85 , srv2039039567:85 , srv236630375:85 , srv349097665:85 , srv456400778:85 , srv651747195:85 , srv832569240:85 , srv1224516620:86 , srv1261228220:86 , srv1288490208:86 , srv1300002857:86 , srv1644027317:86 , srv1729161011:86 , srv1750432516:86 , srv1826710617:86 , srv1870344878:86 , srv1987180854:86 , srv2034676923:86 , srv307047240:86 , srv399236599:86 , srv458833273:86 , srv482678262:86 , srv549216374:86 , srv577225599:86 , srv581210532:86 , srv642606883:86 , srv660077977:86 , srv67567968:86 , srv703798266:86 , srv886377692:86 , srv950633917:86 , srv1335004688:87 , srv1348023820:87 , srv1362989230:87 , srv139307826:87 , srv1735262094:87 , srv1736956446:87 , srv1737618045:87 , srv1962536225:87 , srv2051300663:87 , srv2086750432:87 , srv2103810204:87 , srv223859658:87 , srv520732234:87 , srv573708371:87 , srv640353412:87 , srv878015410:87 , srv1296937873:88 , srv1511771072:88 , srv1611571048:88 , srv1729431543:88 , srv1775628848:88 , srv18876235:88 , srv548895437:88 , srv589028594:88 , srv70210989:88 , srv1207111361:89 , srv1266547371:89 , srv1313498440:89 , srv1519532610:89 , srv1539278148:89 , srv1624164387:89 , srv174807795:89 , srv662746774:89 , srv758575738:89 , srv771535226:89 , srv2077082345:90 , srv799173418:90 , srv306193564:92 , srv56094483:92 , srv675632116:92 , srv1137721467:93 , srv1858400378:93 , srv2112324613:93 , srv507040996:441 }
2023-10-05 23:53:26,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:26,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:26,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:26,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:26,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:26,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:26,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:26,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:26,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:26,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:26,722 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039486667463145775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05984641772844092, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039486667463145775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17191666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:26,722 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-05 23:53:26,723 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17699627504005033, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039486667463145775, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05984641772844092, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039486667463145775, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17191666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24175, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-05 23:53:27,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 590 ms to try 5000 different iterations.  Found a solution that moves 2593 regions; Going from a computed imbalance of 0.17699627504005033 to a new imbalance of 0.014242975902609189. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022833347669717865); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037335497772755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2881111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022833347669717865); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04658333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:27,157 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1858400378:78 , srv2077082345:79 , srv1137721467:80 , srv174807795:80 , srv18876235:80 , srv2112324613:80 , srv306193564:80 , srv56094483:80 , srv1266547371:81 , srv1539278148:81 , srv675632116:81 , srv1335004688:82 , srv1511771072:82 , srv589028594:82 , srv70210989:82 , srv771535226:82 , srv1296937873:83 , srv1313498440:83 , srv1362989230:83 , srv1624164387:83 , srv2103810204:83 , srv1207111361:84 , srv1261228220:84 , srv1519532610:84 , srv1962536225:84 , srv2051300663:84 , srv548895437:84 , srv573708371:84 , srv662746774:84 , srv758575738:84 , srv799173418:84 , srv950633917:84 , srv1041397131:85 , srv1224516620:85 , srv1263304672:85 , srv1611571048:85 , srv1729161011:85 , srv1750432516:85 , srv1775628848:85 , srv2086750432:85 , srv223859658:85 , srv577225599:85 , srv640353412:85 , srv703798266:85 , srv1288490208:86 , srv1348023820:86 , srv139307826:86 , srv1457655760:86 , srv1644027317:86 , srv1729431543:86 , srv1735262094:86 , srv1736956446:86 , srv1870344878:86 , srv1987180854:86 , srv307047240:86 , srv349097665:86 , srv456400778:86 , srv520732234:86 , srv549216374:86 , srv581210532:86 , srv642606883:86 , srv660077977:86 , srv832569240:86 , srv878015410:86 , srv886377692:86 , srv1071927634:87 , srv118330364:87 , srv1300002857:87 , srv1737618045:87 , srv1826710617:87 , srv2039039567:87 , srv236630375:87 , srv482678262:87 , srv67567968:87 , srv995152450:87 , srv1121179730:88 , srv117916023:88 , srv1339803896:88 , srv2034676923:88 , srv370046694:88 , srv399236599:88 , srv63612478:88 , srv651747195:88 , srv677502965:88 , srv1106728526:89 , srv1132221192:89 , srv118627012:89 , srv1561133118:89 , srv2124064669:89 , srv458833273:89 , srv700898909:89 , srv159951077:90 , srv1601041451:90 , srv310366257:90 , srv427430356:90 , srv567204571:90 , srv847952077:90 , srv1960429336:91 , srv18315749:93 , srv507040996:536 }
2023-10-05 23:53:27,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:27,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:27,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:27,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:27,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:27,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:27,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:27,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:27,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:27,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:27,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:27,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:27,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:27,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:27,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022833347669717865); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037335497772755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022833347669717865); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04658333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:27,372 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-05 23:53:27,373 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014224819328540951, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022833347669717865); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037335497772755, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022833347669717865); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010833333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04658333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-05 23:53:27,710 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 499 ms to try 5000 different iterations.  Found a solution that moves 1056 regions; Going from a computed imbalance of 0.014224819328540951 to a new imbalance of 7.211818463683689E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005247342690579975); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.11733333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005247342690579975); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:27,713 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1601041451:82 , srv1729431543:83 , srv2034676923:83 , srv2112324613:83 , srv310366257:83 , srv427430356:83 , srv458833273:83 , srv799173418:83 , srv878015410:83 , srv118330364:84 , srv1296937873:84 , srv1300002857:84 , srv1611571048:84 , srv1735262094:84 , srv1737618045:84 , srv18315749:84 , srv306193564:84 , srv399236599:84 , srv520732234:84 , srv642606883:84 , srv675632116:84 , srv758575738:84 , srv847952077:84 , srv1071927634:85 , srv1106728526:85 , srv1121179730:85 , srv1132221192:85 , srv1137721467:85 , srv118627012:85 , srv1207111361:85 , srv1339803896:85 , srv139307826:85 , srv1519532610:85 , srv1561133118:85 , srv159951077:85 , srv1960429336:85 , srv2086750432:85 , srv2124064669:85 , srv482678262:85 , srv548895437:85 , srv581210532:85 , srv651747195:85 , srv662746774:85 , srv67567968:85 , srv771535226:85 , srv886377692:85 , srv117916023:86 , srv1266547371:86 , srv1288490208:86 , srv1313498440:86 , srv1348023820:86 , srv1624164387:86 , srv1644027317:86 , srv1729161011:86 , srv1736956446:86 , srv1750432516:86 , srv1775628848:86 , srv1826710617:86 , srv1858400378:86 , srv1962536225:86 , srv1987180854:86 , srv223859658:86 , srv236630375:86 , srv307047240:86 , srv549216374:86 , srv56094483:86 , srv567204571:86 , srv640353412:86 , srv660077977:86 , srv677502965:86 , srv700898909:86 , srv832569240:86 , srv995152450:86 , srv1041397131:87 , srv1224516620:87 , srv1261228220:87 , srv1263304672:87 , srv1362989230:87 , srv1457655760:87 , srv1511771072:87 , srv1870344878:87 , srv2039039567:87 , srv2051300663:87 , srv2103810204:87 , srv349097665:87 , srv456400778:87 , srv573708371:87 , srv577225599:87 , srv589028594:87 , srv70210989:87 , srv1539278148:88 , srv18876235:88 , srv2077082345:88 , srv370046694:88 , srv63612478:88 , srv703798266:88 , srv1335004688:89 , srv174807795:89 , srv950633917:89 , srv507040996:527 }
2023-10-05 23:53:27,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:27,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:27,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:27,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:27,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:27,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:27,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:27,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:27,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:27,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:27,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:27,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:27,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:27,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:27,919 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005247342690579975); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005247342690579975); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:27,919 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-05 23:53:27,920 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.137875763274663E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005247342690579975); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005247342690579975); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00475); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-05 23:53:28,308 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 526 ms to try 5000 different iterations.  Found a solution that moves 278 regions; Going from a computed imbalance of 7.137875763274663E-4 to a new imbalance of 4.623535393632334E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.03088888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:28,310 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv63612478:82 , srv1348023820:83 , srv1736956446:83 , srv1775628848:83 , srv1826710617:83 , srv1870344878:83 , srv2039039567:83 , srv703798266:83 , srv950633917:83 , srv1121179730:84 , srv1137721467:84 , srv117916023:84 , srv118627012:84 , srv1207111361:84 , srv1224516620:84 , srv1313498440:84 , srv1335004688:84 , srv1362989230:84 , srv139307826:84 , srv1457655760:84 , srv1519532610:84 , srv1539278148:84 , srv1601041451:84 , srv1624164387:84 , srv1737618045:84 , srv174807795:84 , srv18315749:84 , srv1858400378:84 , srv1960429336:84 , srv1987180854:84 , srv2051300663:84 , srv2124064669:84 , srv236630375:84 , srv310366257:84 , srv349097665:84 , srv370046694:84 , srv399236599:84 , srv456400778:84 , srv458833273:84 , srv482678262:84 , srv549216374:84 , srv56094483:84 , srv567204571:84 , srv573708371:84 , srv581210532:84 , srv640353412:84 , srv651747195:84 , srv660077977:84 , srv662746774:84 , srv67567968:84 , srv677502965:84 , srv700898909:84 , srv799173418:84 , srv886377692:84 , srv1041397131:85 , srv1071927634:85 , srv1106728526:85 , srv1132221192:85 , srv1261228220:85 , srv1263304672:85 , srv1266547371:85 , srv1288490208:85 , srv1300002857:85 , srv1339803896:85 , srv1511771072:85 , srv1561133118:85 , srv1611571048:85 , srv1644027317:85 , srv1729161011:85 , srv1729431543:85 , srv1735262094:85 , srv1750432516:85 , srv18876235:85 , srv2034676923:85 , srv2086750432:85 , srv2103810204:85 , srv223859658:85 , srv307047240:85 , srv427430356:85 , srv520732234:85 , srv548895437:85 , srv577225599:85 , srv589028594:85 , srv642606883:85 , srv675632116:85 , srv70210989:85 , srv758575738:85 , srv832569240:85 , srv847952077:85 , srv995152450:85 , srv159951077:86 , srv1962536225:86 , srv2077082345:86 , srv2112324613:86 , srv306193564:86 , srv771535226:86 , srv878015410:86 , srv118330364:87 , srv1296937873:87 , srv507040996:638 }
2023-10-05 23:53:28,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:28,315 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:28,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:28,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:28,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:28,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:28,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:28,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:28,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:28,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:28,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:28,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:28,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:28,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:28,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:28,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:28,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:28,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:28,477 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:28,478 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-05 23:53:28,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.4288756330858464E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-05 23:53:28,823 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 464 ms to try 5000 different iterations.  Found a solution that moves 46 regions; Going from a computed imbalance of 4.4288756330858464E-5 to a new imbalance of 7.395338180686946E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.005111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:28,824 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv118330364:83 , srv1288490208:83 , srv159951077:83 , srv1644027317:83 , srv1962536225:83 , srv2077082345:83 , srv223859658:83 , srv307047240:83 , srv577225599:83 , srv700898909:83 , srv1041397131:84 , srv1071927634:84 , srv1106728526:84 , srv1121179730:84 , srv1132221192:84 , srv1137721467:84 , srv117916023:84 , srv118627012:84 , srv1207111361:84 , srv1224516620:84 , srv1261228220:84 , srv1263304672:84 , srv1296937873:84 , srv1300002857:84 , srv1313498440:84 , srv1335004688:84 , srv1339803896:84 , srv1348023820:84 , srv139307826:84 , srv1457655760:84 , srv1511771072:84 , srv1519532610:84 , srv1539278148:84 , srv1561133118:84 , srv1611571048:84 , srv1624164387:84 , srv1729161011:84 , srv1729431543:84 , srv1735262094:84 , srv1736956446:84 , srv1737618045:84 , srv174807795:84 , srv1750432516:84 , srv1775628848:84 , srv1826710617:84 , srv18315749:84 , srv1870344878:84 , srv1960429336:84 , srv1987180854:84 , srv2034676923:84 , srv2039039567:84 , srv2051300663:84 , srv2086750432:84 , srv2103810204:84 , srv2112324613:84 , srv2124064669:84 , srv236630375:84 , srv306193564:84 , srv349097665:84 , srv370046694:84 , srv399236599:84 , srv427430356:84 , srv456400778:84 , srv458833273:84 , srv482678262:84 , srv520732234:84 , srv548895437:84 , srv549216374:84 , srv56094483:84 , srv567204571:84 , srv573708371:84 , srv589028594:84 , srv63612478:84 , srv640353412:84 , srv651747195:84 , srv660077977:84 , srv662746774:84 , srv675632116:84 , srv67567968:84 , srv677502965:84 , srv70210989:84 , srv703798266:84 , srv758575738:84 , srv771535226:84 , srv832569240:84 , srv847952077:84 , srv878015410:84 , srv950633917:84 , srv995152450:84 , srv1266547371:85 , srv1362989230:85 , srv1601041451:85 , srv1858400378:85 , srv18876235:85 , srv310366257:85 , srv581210532:85 , srv642606883:85 , srv799173418:85 , srv886377692:85 , srv507040996:684 }
2023-10-05 23:53:28,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:28,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1457655760=23, srv1729431543=34, srv1335004688=18, srv1339803896=19, srv700898909=88, srv2086750432=53, srv349097665=62, srv758575738=91, srv1362989230=21, srv1737618045=37, srv2112324613=55, srv1071927634=1, srv174807795=38, srv1121179730=3, srv581210532=77, srv878015410=96, srv1511771072=24, srv1106728526=2, srv2051300663=51, srv549216374=72, srv70210989=89, srv2039039567=50, srv1987180854=48, srv310366257=61, srv771535226=92, srv1261228220=11, srv67567968=86, srv886377692=97, srv1870344878=44, srv1561133118=27, srv1735262094=35, srv577225599=76, srv950633917=98, srv18876235=45, srv675632116=85, srv1132221192=4, srv1041397131=0, srv117916023=6, srv1539278148=26, srv1207111361=9, srv118627012=8, srv2103810204=54, srv832569240=94, srv1313498440=17, srv1224516620=10, srv660077977=83, srv1288490208=14, srv1736956446=36, srv1729161011=33, srv2124064669=56, srv56094483=73, srv642606883=81, srv677502965=87, srv995152450=99, srv1611571048=30, srv118330364=7, srv63612478=79, srv703798266=90, srv370046694=63, srv458833273=67, srv662746774=84, srv2077082345=52, srv159951077=28, srv1601041451=29, srv18315749=42, srv1266547371=13, srv306193564=59, srv456400778=66, srv1348023820=20, srv1137721467=5, srv1858400378=43, srv139307826=22, srv1826710617=41, srv1644027317=32, srv1962536225=47, srv236630375=58, srv520732234=70, srv1519532610=25, srv589028594=78, srv1624164387=31, srv1750432516=39, srv307047240=60, srv223859658=57, srv1775628848=40, srv567204571=74, srv1300002857=16, srv399236599=64, srv640353412=80, srv1263304672=12, srv651747195=82, srv1296937873=15, srv548895437=71, srv573708371=75, srv482678262=68, srv2034676923=49, srv847952077=95, srv507040996=69, srv1960429336=46, srv799173418=93, srv427430356=65} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:28,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:28,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:28,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-05 23:53:28,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-05 23:53:28,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-05 23:53:28,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-05 23:53:28,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-05 23:53:28,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-05 23:53:28,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-05 23:53:28,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-05 23:53:28,970 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:28,970 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv118330364:83 , srv1288490208:83 , srv159951077:83 , srv1644027317:83 , srv1962536225:83 , srv2077082345:83 , srv223859658:83 , srv307047240:83 , srv577225599:83 , srv700898909:83 , srv1041397131:84 , srv1071927634:84 , srv1106728526:84 , srv1121179730:84 , srv1132221192:84 , srv1137721467:84 , srv117916023:84 , srv118627012:84 , srv1207111361:84 , srv1224516620:84 , srv1261228220:84 , srv1263304672:84 , srv1296937873:84 , srv1300002857:84 , srv1313498440:84 , srv1335004688:84 , srv1339803896:84 , srv1348023820:84 , srv139307826:84 , srv1457655760:84 , srv1511771072:84 , srv1519532610:84 , srv1539278148:84 , srv1561133118:84 , srv1611571048:84 , srv1624164387:84 , srv1729161011:84 , srv1729431543:84 , srv1735262094:84 , srv1736956446:84 , srv1737618045:84 , srv174807795:84 , srv1750432516:84 , srv1775628848:84 , srv1826710617:84 , srv18315749:84 , srv1870344878:84 , srv1960429336:84 , srv1987180854:84 , srv2034676923:84 , srv2039039567:84 , srv2051300663:84 , srv2086750432:84 , srv2103810204:84 , srv2112324613:84 , srv2124064669:84 , srv236630375:84 , srv306193564:84 , srv349097665:84 , srv370046694:84 , srv399236599:84 , srv427430356:84 , srv456400778:84 , srv458833273:84 , srv482678262:84 , srv520732234:84 , srv548895437:84 , srv549216374:84 , srv56094483:84 , srv567204571:84 , srv573708371:84 , srv589028594:84 , srv63612478:84 , srv640353412:84 , srv651747195:84 , srv660077977:84 , srv662746774:84 , srv675632116:84 , srv67567968:84 , srv677502965:84 , srv70210989:84 , srv703798266:84 , srv758575738:84 , srv771535226:84 , srv832569240:84 , srv847952077:84 , srv878015410:84 , srv950633917:84 , srv995152450:84 , srv1266547371:85 , srv1362989230:85 , srv1601041451:85 , srv1858400378:85 , srv18876235:85 , srv310366257:85 , srv581210532:85 , srv642606883:85 , srv799173418:85 , srv886377692:85 , srv507040996:684 }
2023-10-05 23:53:28,999 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 308) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=7195 (was 7223)
2023-10-05 23:53:29,010 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=172, AvailableMemoryMB=7194
2023-10-05 23:53:29,011 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-05 23:53:29,011 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-05 23:53:29,023 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1061006381:84 , srv1062930625:84 , srv1074415918:84 , srv114534536:84 , srv1255367588:84 , srv1268292038:84 , srv1268992087:84 , srv1341869002:84 , srv1727117329:84 , srv1752089893:84 , srv180633284:84 , srv1823758742:84 , srv1860321653:84 , srv193678582:84 , srv308536534:84 , srv332603418:84 , srv349502239:84 , srv366235989:84 , srv408099350:84 , srv454887241:84 , srv47146359:84 , srv610340641:84 , srv630835519:84 , srv654662244:84 , srv731869956:84 , srv738047473:84 , srv758424504:84 , srv893359420:84 , srv998319708:84 , srv398260201:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-05 23:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv398260201=18, srv408099350=19, srv758424504=27, srv1860321653=12, srv738047473=26, srv1255367588=4, srv1074415918=2, srv193678582=13, srv610340641=22, srv454887241=20, srv1062930625=1, srv630835519=23, srv998319708=29, srv1727117329=8, srv1823758742=11, srv1268992087=6, srv1341869002=7, srv1752089893=9, srv366235989=17, srv332603418=15, srv349502239=16, srv308536534=14, srv114534536=3, srv893359420=28, srv1268292038=5, srv654662244=24, srv1061006381=0, srv180633284=10, srv47146359=21, srv731869956=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:53:29,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:53:29,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:53:29,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-05 23:53:29,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1536129271601816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:53:29,066 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912677072581837, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1536129271601816, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-05 23:55:29,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5489053 different iterations.  Found a solution that moves 1862 regions; Going from a computed imbalance of 0.9912677072581837 to a new imbalance of 4.346000888939571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6896296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:55:29,050 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061006381:90 , srv1062930625:90 , srv1074415918:90 , srv114534536:90 , srv1255367588:90 , srv1268292038:90 , srv1268992087:90 , srv1341869002:90 , srv1727117329:90 , srv1752089893:90 , srv180633284:90 , srv1823758742:90 , srv1860321653:90 , srv193678582:90 , srv308536534:90 , srv332603418:90 , srv349502239:90 , srv366235989:90 , srv398260201:90 , srv408099350:90 , srv454887241:90 , srv47146359:90 , srv610340641:90 , srv630835519:90 , srv654662244:90 , srv731869956:90 , srv738047473:90 , srv758424504:90 , srv893359420:90 , srv998319708:90 }
2023-10-05 23:55:29,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-05 23:55:29,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv398260201=18, srv408099350=19, srv758424504=27, srv1860321653=12, srv738047473=26, srv1255367588=4, srv1074415918=2, srv193678582=13, srv610340641=22, srv454887241=20, srv1062930625=1, srv630835519=23, srv998319708=29, srv1727117329=8, srv1823758742=11, srv1268992087=6, srv1341869002=7, srv1752089893=9, srv366235989=17, srv332603418=15, srv349502239=16, srv308536534=14, srv114534536=3, srv893359420=28, srv1268292038=5, srv654662244=24, srv1061006381=0, srv180633284=10, srv47146359=21, srv731869956=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-05 23:55:29,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-05 23:55:29,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-05 23:55:29,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-05 23:55:29,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-05 23:55:29,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-05 23:55:29,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-05 23:55:29,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-05 23:55:29,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-05 23:55:29,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-05 23:55:29,067 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1061006381:90 , srv1062930625:90 , srv1074415918:90 , srv114534536:90 , srv1255367588:90 , srv1268292038:90 , srv1268992087:90 , srv1341869002:90 , srv1727117329:90 , srv1752089893:90 , srv180633284:90 , srv1823758742:90 , srv1860321653:90 , srv193678582:90 , srv308536534:90 , srv332603418:90 , srv349502239:90 , srv366235989:90 , srv398260201:90 , srv408099350:90 , srv454887241:90 , srv47146359:90 , srv610340641:90 , srv630835519:90 , srv654662244:90 , srv731869956:90 , srv738047473:90 , srv758424504:90 , srv893359420:90 , srv998319708:90 }
2023-10-05 23:55:29,081 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 315), ProcessCount=168 (was 172), AvailableMemoryMB=6060 (was 7194)