2023-11-08 06:59:10,194 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-08 06:59:10,462 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-08 06:59:10,568 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-08 06:59:10,627 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-08 06:59:10,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-08 06:59:10,649 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=178, AvailableMemoryMB=8615
2023-11-08 06:59:10,651 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-08 06:59:10,652 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-08 06:59:10,790 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007194538:84 , srv1009585034:84 , srv1030052370:84 , srv1086642994:84 , srv1095707304:84 , srv1097510508:84 , srv1145282781:84 , srv1152629938:84 , srv1189249873:84 , srv1240668178:84 , srv124578034:84 , srv127229108:84 , srv1276663349:84 , srv1277810172:84 , srv1282411799:84 , srv1301700958:84 , srv1316239199:84 , srv1388474097:84 , srv141852021:84 , srv1441764900:84 , srv1444125255:84 , srv1474628518:84 , srv1489219878:84 , srv1494184998:84 , srv1497465179:84 , srv1498939896:84 , srv150653096:84 , srv1521912290:84 , srv1553516751:84 , srv1576664031:84 , srv1581939927:84 , srv1583821647:84 , srv1587572751:84 , srv1594773798:84 , srv1608875108:84 , srv1638985900:84 , srv1640616449:84 , srv1655001620:84 , srv1655757412:84 , srv1692937669:84 , srv1712113710:84 , srv1722401095:84 , srv1744648157:84 , srv1787535083:84 , srv1823832207:84 , srv1875263976:84 , srv1938252599:84 , srv1940297327:84 , srv1997385816:84 , srv2011347877:84 , srv2051765595:84 , srv2055731132:84 , srv2095093822:84 , srv224107912:84 , srv254622530:84 , srv257070466:84 , srv301366393:84 , srv317691161:84 , srv330127792:84 , srv33798377:84 , srv356955260:84 , srv361935389:84 , srv364673231:84 , srv369303031:84 , srv386106797:84 , srv391034406:84 , srv40032109:84 , srv405061697:84 , srv406113768:84 , srv422879541:84 , srv446652071:84 , srv465120352:84 , srv502630758:84 , srv507687595:84 , srv566141702:84 , srv635519842:84 , srv706372246:84 , srv707600483:84 , srv711495399:84 , srv722733046:84 , srv730129942:84 , srv74724827:84 , srv755881583:84 , srv784519086:84 , srv785970568:84 , srv813027636:84 , srv813585506:84 , srv822803424:84 , srv857899875:84 , srv867853582:84 , srv905583942:84 , srv915288386:84 , srv924845698:84 , srv929927786:84 , srv954613423:84 , srv961679373:84 , srv963332146:84 , srv965127335:84 , srv999811362:84 , srv1688380964:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-08 06:59:10,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:10,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:10,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:10,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:10,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:10,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:10,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:10,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:10,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:10,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:10,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:10,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:10,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:11,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:11,031 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-08 06:59:11,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-08 06:59:11,308 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 399 ms to try 5000 different iterations.  Found a solution that moves 4689 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18384655921992663. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039274185587644776, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054597805031463005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.521, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039274185587644776, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24608333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:11,330 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1997385816:81 , srv1787535083:82 , srv635519842:82 , srv722733046:82 , srv141852021:83 , srv1938252599:83 , srv257070466:83 , srv711495399:83 , srv965127335:83 , srv1007194538:84 , srv1276663349:84 , srv1301700958:84 , srv1494184998:84 , srv1587572751:84 , srv33798377:84 , srv356955260:84 , srv364673231:84 , srv707600483:84 , srv857899875:84 , srv1189249873:85 , srv1316239199:85 , srv1388474097:85 , srv1444125255:85 , srv1489219878:85 , srv1594773798:85 , srv1692937669:85 , srv1823832207:85 , srv2055731132:85 , srv224107912:85 , srv422879541:85 , srv465120352:85 , srv502630758:85 , srv813585506:85 , srv867853582:85 , srv963332146:85 , srv1009585034:86 , srv1030052370:86 , srv1145282781:86 , srv1441764900:86 , srv1474628518:86 , srv1497465179:86 , srv150653096:86 , srv1521912290:86 , srv1638985900:86 , srv1640616449:86 , srv1744648157:86 , srv2011347877:86 , srv330127792:86 , srv369303031:86 , srv40032109:86 , srv405061697:86 , srv74724827:86 , srv784519086:86 , srv785970568:86 , srv905583942:86 , srv915288386:86 , srv929927786:86 , srv954613423:86 , srv999811362:86 , srv1097510508:87 , srv1152629938:87 , srv1583821647:87 , srv1940297327:87 , srv301366393:87 , srv317691161:87 , srv361935389:87 , srv391034406:87 , srv507687595:87 , srv813027636:87 , srv822803424:87 , srv1086642994:88 , srv1240668178:88 , srv124578034:88 , srv127229108:88 , srv1608875108:88 , srv1655001620:88 , srv1722401095:88 , srv406113768:88 , srv446652071:88 , srv566141702:88 , srv1095707304:89 , srv1282411799:89 , srv1498939896:89 , srv1712113710:89 , srv1875263976:89 , srv2095093822:89 , srv254622530:89 , srv706372246:89 , srv730129942:89 , srv755881583:89 , srv924845698:89 , srv961679373:89 , srv1553516751:91 , srv2051765595:91 , srv1655757412:92 , srv1576664031:93 , srv386106797:93 , srv1581939927:94 , srv1277810172:96 , srv1688380964:439 }
2023-11-08 06:59:11,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:11,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:11,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:11,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:11,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:11,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:11,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:11,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:11,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:11,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:11,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:11,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:11,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:11,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:11,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:11,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039274185587644776, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054597805031463005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039274185587644776, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24608333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:11,472 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-08 06:59:11,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18381372614017114, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039274185587644776, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054597805031463005, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039274185587644776, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24608333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-08 06:59:11,711 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 333 ms to try 5000 different iterations.  Found a solution that moves 2613 regions; Going from a computed imbalance of 0.18381372614017114 to a new imbalance of 0.015241331746823553. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02183443921885779); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0351619629196613, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29033333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02183443921885779); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:11,721 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1277810172:77 , srv386106797:77 , srv1576664031:79 , srv1655757412:80 , srv730129942:80 , srv1282411799:81 , srv1581939927:81 , srv1498939896:82 , srv1553516751:82 , srv1722401095:82 , srv2051765595:82 , srv755881583:82 , srv961679373:82 , srv1095707304:83 , srv127229108:83 , srv1712113710:83 , srv254622530:83 , srv566141702:83 , srv924845698:83 , srv929927786:83 , srv1030052370:84 , srv1097510508:84 , srv1497465179:84 , srv1583821647:84 , srv1608875108:84 , srv1638985900:84 , srv1640616449:84 , srv1875263976:84 , srv2095093822:84 , srv369303031:84 , srv391034406:84 , srv406113768:84 , srv446652071:84 , srv822803424:84 , srv1009585034:85 , srv1086642994:85 , srv1145282781:85 , srv1152629938:85 , srv1240668178:85 , srv124578034:85 , srv1441764900:85 , srv1594773798:85 , srv301366393:85 , srv40032109:85 , srv963332146:85 , srv1316239199:86 , srv1388474097:86 , srv1444125255:86 , srv1494184998:86 , srv1655001620:86 , srv1940297327:86 , srv257070466:86 , srv317691161:86 , srv330127792:86 , srv361935389:86 , srv405061697:86 , srv507687595:86 , srv706372246:86 , srv813027636:86 , srv915288386:86 , srv954613423:86 , srv1189249873:87 , srv1301700958:87 , srv1474628518:87 , srv1587572751:87 , srv1744648157:87 , srv2011347877:87 , srv33798377:87 , srv364673231:87 , srv422879541:87 , srv502630758:87 , srv784519086:87 , srv785970568:87 , srv813585506:87 , srv867853582:87 , srv905583942:87 , srv141852021:88 , srv1489219878:88 , srv1521912290:88 , srv1938252599:88 , srv224107912:88 , srv356955260:88 , srv465120352:88 , srv707600483:88 , srv1007194538:89 , srv150653096:89 , srv1692937669:89 , srv1787535083:89 , srv2055731132:89 , srv857899875:89 , srv965127335:89 , srv999811362:89 , srv1276663349:90 , srv1823832207:90 , srv711495399:90 , srv1997385816:91 , srv635519842:91 , srv74724827:91 , srv722733046:92 , srv1688380964:529 }
2023-11-08 06:59:11,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:11,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:11,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:11,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:11,855 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02183443921885779); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0351619629196613, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02183443921885779); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:11,855 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-08 06:59:11,856 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015223035129762115, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02183443921885779); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0351619629196613, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02183443921885779); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.047, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-08 06:59:12,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 280 ms to try 5000 different iterations.  Found a solution that moves 1007 regions; Going from a computed imbalance of 0.015223035129762115 to a new imbalance of 0.0014268659945712264. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007792994574261433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010412372852405373); MoveCostFunction : (multiplier=7.0, imbalance=0.11188888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007792994574261433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.001); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,047 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv706372246:81 , srv74724827:81 , srv1276663349:82 , srv150653096:82 , srv1521912290:82 , srv1823832207:82 , srv1581939927:83 , srv1655001620:83 , srv785970568:83 , srv999811362:83 , srv1007194538:84 , srv1095707304:84 , srv1240668178:84 , srv124578034:84 , srv1277810172:84 , srv1474628518:84 , srv1744648157:84 , srv2011347877:84 , srv2051765595:84 , srv2055731132:84 , srv2095093822:84 , srv301366393:84 , srv317691161:84 , srv465120352:84 , srv507687595:84 , srv635519842:84 , srv711495399:84 , srv722733046:84 , srv813027636:84 , srv813585506:84 , srv1086642994:85 , srv1097510508:85 , srv1152629938:85 , srv1388474097:85 , srv1441764900:85 , srv1489219878:85 , srv1553516751:85 , srv1608875108:85 , srv1692937669:85 , srv1787535083:85 , srv1875263976:85 , srv1997385816:85 , srv224107912:85 , srv254622530:85 , srv356955260:85 , srv361935389:85 , srv40032109:85 , srv422879541:85 , srv446652071:85 , srv502630758:85 , srv707600483:85 , srv857899875:85 , srv905583942:85 , srv924845698:85 , srv954613423:85 , srv1009585034:86 , srv1189249873:86 , srv127229108:86 , srv1444125255:86 , srv1494184998:86 , srv1498939896:86 , srv1576664031:86 , srv1640616449:86 , srv1655757412:86 , srv1712113710:86 , srv1940297327:86 , srv330127792:86 , srv33798377:86 , srv386106797:86 , srv391034406:86 , srv405061697:86 , srv406113768:86 , srv566141702:86 , srv755881583:86 , srv784519086:86 , srv822803424:86 , srv867853582:86 , srv915288386:86 , srv965127335:86 , srv1145282781:87 , srv1301700958:87 , srv1497465179:87 , srv1583821647:87 , srv1587572751:87 , srv1594773798:87 , srv1638985900:87 , srv1938252599:87 , srv364673231:87 , srv961679373:87 , srv963332146:87 , srv1030052370:88 , srv1282411799:88 , srv1316239199:88 , srv141852021:88 , srv1722401095:88 , srv257070466:88 , srv369303031:88 , srv730129942:88 , srv929927786:89 , srv1688380964:559 }
2023-11-08 06:59:12,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:12,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:12,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:12,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:12,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:12,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:12,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:12,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:12,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:12,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:12,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:12,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:12,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:12,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:12,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007792994574261433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010412372852405373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007792994574261433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.001); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,178 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-08 06:59:12,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.001419814829863661, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007792994574261433); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010412372852405373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007792994574261433); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.001); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-08 06:59:12,452 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 361 ms to try 5000 different iterations.  Found a solution that moves 321 regions; Going from a computed imbalance of 0.001419814829863661 to a new imbalance of 3.607057858377256E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.035666666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,453 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086642994:83 , srv1316239199:83 , srv141852021:83 , srv1692937669:83 , srv1940297327:83 , srv905583942:83 , srv1007194538:84 , srv1145282781:84 , srv1189249873:84 , srv1282411799:84 , srv1301700958:84 , srv1474628518:84 , srv1489219878:84 , srv1576664031:84 , srv1581939927:84 , srv1583821647:84 , srv1587572751:84 , srv1638985900:84 , srv1655757412:84 , srv1712113710:84 , srv1722401095:84 , srv1744648157:84 , srv1875263976:84 , srv1938252599:84 , srv224107912:84 , srv330127792:84 , srv361935389:84 , srv364673231:84 , srv369303031:84 , srv406113768:84 , srv635519842:84 , srv722733046:84 , srv730129942:84 , srv74724827:84 , srv784519086:84 , srv857899875:84 , srv867853582:84 , srv915288386:84 , srv954613423:84 , srv961679373:84 , srv965127335:84 , srv999811362:84 , srv1009585034:85 , srv1030052370:85 , srv1097510508:85 , srv1152629938:85 , srv124578034:85 , srv127229108:85 , srv1277810172:85 , srv1444125255:85 , srv1494184998:85 , srv1497465179:85 , srv1498939896:85 , srv150653096:85 , srv1553516751:85 , srv1594773798:85 , srv1608875108:85 , srv1655001620:85 , srv1823832207:85 , srv1997385816:85 , srv2011347877:85 , srv2051765595:85 , srv2055731132:85 , srv2095093822:85 , srv254622530:85 , srv257070466:85 , srv317691161:85 , srv356955260:85 , srv391034406:85 , srv405061697:85 , srv422879541:85 , srv446652071:85 , srv465120352:85 , srv502630758:85 , srv566141702:85 , srv707600483:85 , srv711495399:85 , srv755881583:85 , srv813027636:85 , srv822803424:85 , srv924845698:85 , srv929927786:85 , srv963332146:85 , srv1095707304:86 , srv1240668178:86 , srv1388474097:86 , srv1441764900:86 , srv1521912290:86 , srv1640616449:86 , srv1787535083:86 , srv301366393:86 , srv33798377:86 , srv40032109:86 , srv507687595:86 , srv706372246:86 , srv785970568:86 , srv813585506:86 , srv1276663349:87 , srv386106797:87 , srv1688380964:615 }
2023-11-08 06:59:12,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:12,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:12,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:12,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:12,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:12,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:12,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:12,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:12,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:12,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:12,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,563 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-08 06:59:12,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.3822888542930025E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-08 06:59:12,728 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 247 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 3.3822888542930025E-5 to a new imbalance of 7.290305935787761E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,728 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1030052370:83 , srv1240668178:83 , srv1276663349:83 , srv1553516751:83 , srv2055731132:83 , srv33798377:83 , srv386106797:83 , srv405061697:83 , srv507687595:83 , srv784519086:83 , srv929927786:83 , srv1009585034:84 , srv1095707304:84 , srv1145282781:84 , srv1152629938:84 , srv1189249873:84 , srv124578034:84 , srv127229108:84 , srv1277810172:84 , srv1282411799:84 , srv1301700958:84 , srv1316239199:84 , srv1388474097:84 , srv141852021:84 , srv1441764900:84 , srv1444125255:84 , srv1489219878:84 , srv1497465179:84 , srv1498939896:84 , srv150653096:84 , srv1521912290:84 , srv1576664031:84 , srv1581939927:84 , srv1583821647:84 , srv1587572751:84 , srv1594773798:84 , srv1608875108:84 , srv1640616449:84 , srv1655001620:84 , srv1655757412:84 , srv1692937669:84 , srv1712113710:84 , srv1722401095:84 , srv1787535083:84 , srv1823832207:84 , srv1875263976:84 , srv1938252599:84 , srv1940297327:84 , srv1997385816:84 , srv2011347877:84 , srv2051765595:84 , srv2095093822:84 , srv224107912:84 , srv254622530:84 , srv257070466:84 , srv301366393:84 , srv317691161:84 , srv330127792:84 , srv356955260:84 , srv361935389:84 , srv364673231:84 , srv369303031:84 , srv391034406:84 , srv40032109:84 , srv406113768:84 , srv422879541:84 , srv446652071:84 , srv465120352:84 , srv502630758:84 , srv566141702:84 , srv706372246:84 , srv707600483:84 , srv711495399:84 , srv722733046:84 , srv74724827:84 , srv755881583:84 , srv785970568:84 , srv813027636:84 , srv813585506:84 , srv822803424:84 , srv857899875:84 , srv867853582:84 , srv915288386:84 , srv924845698:84 , srv961679373:84 , srv963332146:84 , srv965127335:84 , srv999811362:84 , srv1007194538:85 , srv1086642994:85 , srv1097510508:85 , srv1474628518:85 , srv1494184998:85 , srv1638985900:85 , srv1744648157:85 , srv635519842:85 , srv730129942:85 , srv905583942:85 , srv954613423:85 , srv1688380964:684 }
2023-11-08 06:59:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:12,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1095707304=4, srv1086642994=3, srv2051765595=51, srv224107912=54, srv822803424=88, srv361935389=62, srv1581939927=30, srv954613423=95, srv1875263976=46, srv1823832207=45, srv1282411799=14, srv391034406=66, srv1722401095=42, srv465120352=72, srv502630758=73, srv1007194538=0, srv254622530=55, srv405061697=68, srv1145282781=6, srv446652071=71, srv364673231=63, srv1744648157=43, srv1444125255=20, srv722733046=80, srv124578034=10, srv2011347877=50, srv1097510508=5, srv1497465179=24, srv1494184998=23, srv1189249873=8, srv730129942=81, srv1316239199=16, srv1938252599=47, srv369303031=64, srv301366393=57, srv1152629938=7, srv1576664031=29, srv857899875=89, srv1583821647=31, srv1489219878=22, srv566141702=75, srv707600483=78, srv999811362=99, srv150653096=26, srv1030052370=2, srv1553516751=28, srv1276663349=12, srv1474628518=21, srv1640616449=36, srv257070466=56, srv813027636=86, srv1688380964=39, srv1388474097=17, srv784519086=84, srv1521912290=27, srv422879541=70, srv406113768=69, srv813585506=87, srv785970568=85, srv867853582=90, srv963332146=97, srv507687595=74, srv1692937669=40, srv1997385816=49, srv386106797=65, srv33798377=60, srv1655757412=38, srv924845698=93, srv1009585034=1, srv1608875108=34, srv1787535083=44, srv356955260=61, srv141852021=18, srv1441764900=19, srv1301700958=15, srv1277810172=13, srv929927786=94, srv1587572751=32, srv1240668178=9, srv915288386=92, srv961679373=96, srv127229108=11, srv635519842=76, srv1498939896=25, srv40032109=67, srv1638985900=35, srv905583942=91, srv1655001620=37, srv711495399=79, srv965127335=98, srv1594773798=33, srv1940297327=48, srv2055731132=52, srv755881583=83, srv74724827=82, srv706372246=77, srv317691161=58, srv330127792=59, srv1712113710=41, srv2095093822=53} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:12,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:12,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:12,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:12,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-08 06:59:12,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-08 06:59:12,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-08 06:59:12,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-08 06:59:12,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-08 06:59:12,838 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,839 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1030052370:83 , srv1240668178:83 , srv1276663349:83 , srv1553516751:83 , srv2055731132:83 , srv33798377:83 , srv386106797:83 , srv405061697:83 , srv507687595:83 , srv784519086:83 , srv929927786:83 , srv1009585034:84 , srv1095707304:84 , srv1145282781:84 , srv1152629938:84 , srv1189249873:84 , srv124578034:84 , srv127229108:84 , srv1277810172:84 , srv1282411799:84 , srv1301700958:84 , srv1316239199:84 , srv1388474097:84 , srv141852021:84 , srv1441764900:84 , srv1444125255:84 , srv1489219878:84 , srv1497465179:84 , srv1498939896:84 , srv150653096:84 , srv1521912290:84 , srv1576664031:84 , srv1581939927:84 , srv1583821647:84 , srv1587572751:84 , srv1594773798:84 , srv1608875108:84 , srv1640616449:84 , srv1655001620:84 , srv1655757412:84 , srv1692937669:84 , srv1712113710:84 , srv1722401095:84 , srv1787535083:84 , srv1823832207:84 , srv1875263976:84 , srv1938252599:84 , srv1940297327:84 , srv1997385816:84 , srv2011347877:84 , srv2051765595:84 , srv2095093822:84 , srv224107912:84 , srv254622530:84 , srv257070466:84 , srv301366393:84 , srv317691161:84 , srv330127792:84 , srv356955260:84 , srv361935389:84 , srv364673231:84 , srv369303031:84 , srv391034406:84 , srv40032109:84 , srv406113768:84 , srv422879541:84 , srv446652071:84 , srv465120352:84 , srv502630758:84 , srv566141702:84 , srv706372246:84 , srv707600483:84 , srv711495399:84 , srv722733046:84 , srv74724827:84 , srv755881583:84 , srv785970568:84 , srv813027636:84 , srv813585506:84 , srv822803424:84 , srv857899875:84 , srv867853582:84 , srv915288386:84 , srv924845698:84 , srv961679373:84 , srv963332146:84 , srv965127335:84 , srv999811362:84 , srv1007194538:85 , srv1086642994:85 , srv1097510508:85 , srv1474628518:85 , srv1494184998:85 , srv1638985900:85 , srv1744648157:85 , srv635519842:85 , srv730129942:85 , srv905583942:85 , srv954613423:85 , srv1688380964:684 }
2023-11-08 06:59:12,860 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=380 (was 380), ProcessCount=178 (was 178), AvailableMemoryMB=8126 (was 8615)
2023-11-08 06:59:12,867 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=178, AvailableMemoryMB=8126
2023-11-08 06:59:12,868 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-08 06:59:12,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-08 06:59:12,879 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1021986493:84 , srv1030508713:84 , srv1140498219:84 , srv1244677430:84 , srv1292446091:84 , srv1389887150:84 , srv1554944400:84 , srv1629828870:84 , srv1631391845:84 , srv1668339302:84 , srv1743708372:84 , srv1750664277:84 , srv1791273297:84 , srv1862605571:84 , srv1964478649:84 , srv2009950737:84 , srv2145017282:84 , srv233881004:84 , srv306064611:84 , srv361728470:84 , srv516104196:84 , srv52567078:84 , srv62329512:84 , srv686565822:84 , srv741469156:84 , srv804941976:84 , srv819025520:84 , srv824638938:84 , srv921532006:84 , srv1826809572:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-08 06:59:12,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 06:59:12,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv824638938=28, srv1244677430=3, srv1631391845=8, srv1021986493=0, srv741469156=25, srv1862605571=14, srv233881004=18, srv1140498219=2, srv516104196=21, srv1030508713=1, srv1743708372=10, srv1826809572=13, srv2009950737=16, srv1292446091=4, srv1389887150=5, srv62329512=23, srv921532006=29, srv361728470=20, srv1554944400=6, srv2145017282=17, srv686565822=24, srv804941976=26, srv1964478649=15, srv306064611=19, srv1750664277=11, srv1668339302=9, srv52567078=22, srv1791273297=12, srv1629828870=7, srv819025520=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 06:59:12,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 06:59:12,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 06:59:12,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-08 06:59:12,915 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0956802052180847, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 06:59:12,915 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912494528466677, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0956802052180847, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-08 07:01:12,898 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9189796 different iterations.  Found a solution that moves 1846 regions; Going from a computed imbalance of 0.9912494528466677 to a new imbalance of 4.308656090753194E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6837037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 07:01:12,903 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021986493:90 , srv1030508713:90 , srv1140498219:90 , srv1244677430:90 , srv1292446091:90 , srv1389887150:90 , srv1554944400:90 , srv1629828870:90 , srv1631391845:90 , srv1668339302:90 , srv1743708372:90 , srv1750664277:90 , srv1791273297:90 , srv1826809572:90 , srv1862605571:90 , srv1964478649:90 , srv2009950737:90 , srv2145017282:90 , srv233881004:90 , srv306064611:90 , srv361728470:90 , srv516104196:90 , srv52567078:90 , srv62329512:90 , srv686565822:90 , srv741469156:90 , srv804941976:90 , srv819025520:90 , srv824638938:90 , srv921532006:90 }
2023-11-08 07:01:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-08 07:01:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv824638938=28, srv1244677430=3, srv1631391845=8, srv1021986493=0, srv741469156=25, srv1862605571=14, srv233881004=18, srv1140498219=2, srv516104196=21, srv1030508713=1, srv1743708372=10, srv1826809572=13, srv2009950737=16, srv1292446091=4, srv1389887150=5, srv62329512=23, srv921532006=29, srv361728470=20, srv1554944400=6, srv2145017282=17, srv686565822=24, srv804941976=26, srv1964478649=15, srv306064611=19, srv1750664277=11, srv1668339302=9, srv52567078=22, srv1791273297=12, srv1629828870=7, srv819025520=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-08 07:01:12,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-08 07:01:12,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-08 07:01:12,918 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-08 07:01:12,918 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1021986493:90 , srv1030508713:90 , srv1140498219:90 , srv1244677430:90 , srv1292446091:90 , srv1389887150:90 , srv1554944400:90 , srv1629828870:90 , srv1631391845:90 , srv1668339302:90 , srv1743708372:90 , srv1750664277:90 , srv1791273297:90 , srv1826809572:90 , srv1862605571:90 , srv1964478649:90 , srv2009950737:90 , srv2145017282:90 , srv233881004:90 , srv306064611:90 , srv361728470:90 , srv516104196:90 , srv52567078:90 , srv62329512:90 , srv686565822:90 , srv741469156:90 , srv804941976:90 , srv819025520:90 , srv824638938:90 , srv921532006:90 }
2023-11-08 07:01:12,929 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 380), ProcessCount=168 (was 178), AvailableMemoryMB=8028 (was 8126)