2024-02-05 07:53:09,324 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-02-05 07:53:09,626 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-02-05 07:53:09,736 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-02-05 07:53:09,801 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-05 07:53:09,810 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-05 07:53:09,827 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=167, AvailableMemoryMB=2183
2024-02-05 07:53:09,830 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-05 07:53:09,831 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-02-05 07:53:09,962 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026961198:84 , srv1036479285:84 , srv1072004390:84 , srv1073953314:84 , srv107904878:84 , srv1105707277:84 , srv1112968723:84 , srv1122610234:84 , srv1131831602:84 , srv1141330019:84 , srv1146484358:84 , srv1158416249:84 , srv1163374247:84 , srv1206969635:84 , srv12147714:84 , srv123373505:84 , srv1239929822:84 , srv1240777436:84 , srv126570307:84 , srv1270723661:84 , srv1303406544:84 , srv1313186500:84 , srv1345109208:84 , srv1352778497:84 , srv1361114052:84 , srv1391317726:84 , srv1392457630:84 , srv1394951032:84 , srv1470982239:84 , srv1537064307:84 , srv1542986485:84 , srv1547118453:84 , srv1620182840:84 , srv1651833786:84 , srv1744177101:84 , srv1753788278:84 , srv1769357811:84 , srv1786445604:84 , srv1852754657:84 , srv1859895939:84 , srv1860423650:84 , srv1903707772:84 , srv191059661:84 , srv1922924724:84 , srv1942040345:84 , srv1952664795:84 , srv1964677008:84 , srv1986230828:84 , srv1989627367:84 , srv1990680479:84 , srv2010609187:84 , srv2024694404:84 , srv2025008998:84 , srv2032494878:84 , srv2041222557:84 , srv2061497469:84 , srv207267864:84 , srv2096190698:84 , srv2110520182:84 , srv2122641806:84 , srv2132514742:84 , srv219347386:84 , srv220595947:84 , srv273535356:84 , srv299707243:84 , srv313205708:84 , srv319862274:84 , srv334257791:84 , srv335806393:84 , srv382859328:84 , srv386436673:84 , srv415437461:84 , srv415840496:84 , srv448620301:84 , srv457933619:84 , srv472459651:84 , srv47921065:84 , srv502472270:84 , srv513831152:84 , srv519779352:84 , srv523908534:84 , srv557949428:84 , srv559756738:84 , srv559904996:84 , srv593098723:84 , srv611545118:84 , srv75621434:84 , srv761988700:84 , srv762798811:84 , srv766903206:84 , srv807360052:84 , srv847020353:84 , srv849775766:84 , srv889767234:84 , srv901503569:84 , srv908468800:84 , srv927953912:84 , srv931317818:84 , srv947121273:84 , srv1352908841:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-02-05 07:53:09,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:09,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1240777436=17, srv1361114052=25, srv502472270=78, srv220595947=63, srv313205708=66, srv2041222557=55, srv593098723=85, srv901503569=95, srv1942040345=45, srv1073953314=3, srv382859328=70, srv762798811=89, srv1112968723=6, srv1270723661=19, srv273535356=64, srv847020353=92, srv1394951032=28, srv1163374247=12, srv559904996=84, srv1744177101=35, srv2122641806=60, srv319862274=67, srv1964677008=47, srv1345109208=22, srv2061497469=56, srv2110520182=59, srv472459651=76, srv761988700=88, srv2024694404=52, srv1026961198=0, srv1206969635=13, srv415437461=72, srv807360052=91, srv931317818=98, srv1986230828=48, srv519779352=80, srv611545118=86, srv12147714=14, srv766903206=90, srv334257791=68, srv1547118453=32, srv1852754657=39, srv1537064307=30, srv1786445604=38, srv1903707772=42, srv123373505=15, srv207267864=57, srv1313186500=21, srv335806393=69, srv1131831602=8, srv1239929822=16, srv1922924724=44, srv457933619=75, srv2025008998=53, srv1072004390=2, srv2096190698=58, srv557949428=82, srv908468800=96, srv2132514742=61, srv1990680479=50, srv1352778497=23, srv107904878=4, srv1859895939=40, srv1753788278=36, srv2010609187=51, srv1952664795=46, srv386436673=71, srv2032494878=54, srv947121273=99, srv1303406544=20, srv47921065=77, srv927953912=97, srv1392457630=27, srv219347386=62, srv1989627367=49, srv1651833786=34, srv523908534=81, srv75621434=87, srv1620182840=33, srv889767234=94, srv1141330019=9, srv849775766=93, srv1036479285=1, srv448620301=74, srv1122610234=7, srv1352908841=24, srv1391317726=26, srv1470982239=29, srv559756738=83, srv513831152=79, srv1542986485=31, srv1769357811=37, srv415840496=73, srv1158416249=11, srv1105707277=5, srv191059661=43, srv299707243=65, srv126570307=18, srv1860423650=41, srv1146484358=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:10,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:10,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:10,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:10,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:10,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:10,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:10,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-05 07:53:10,075 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-05 07:53:10,076 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-05 07:53:10,077 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-05 07:53:10,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-05 07:53:10,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-05 07:53:10,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-05 07:53:10,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-05 07:53:10,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-05 07:53:10,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-05 07:53:10,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-05 07:53:10,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-05 07:53:10,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-05 07:53:10,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-05 07:53:10,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-05 07:53:10,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-05 07:53:10,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-05 07:53:10,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-05 07:53:10,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-05 07:53:10,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-05 07:53:10,265 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:10,266 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-05 07:53:10,266 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-05 07:53:10,626 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 511 ms to try 5000 different iterations.  Found a solution that moves 4672 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17889463994122579. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04058771383102503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05146343214832109, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5191111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04058771383102503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17391666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:10,657 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1105707277:83 , srv1141330019:83 , srv1158416249:83 , srv1313186500:83 , srv1392457630:83 , srv1964677008:83 , srv513831152:83 , srv762798811:83 , srv901503569:83 , srv1470982239:84 , srv1537064307:84 , srv1852754657:84 , srv1922924724:84 , srv1952664795:84 , srv2041222557:84 , srv207267864:84 , srv2122641806:84 , srv313205708:84 , srv519779352:84 , srv807360052:84 , srv927953912:84 , srv1073953314:85 , srv107904878:85 , srv1122610234:85 , srv1206969635:85 , srv126570307:85 , srv1345109208:85 , srv1352778497:85 , srv1394951032:85 , srv1547118453:85 , srv1744177101:85 , srv1786445604:85 , srv415840496:85 , srv47921065:85 , srv502472270:85 , srv559756738:85 , srv931317818:85 , srv1026961198:86 , srv1072004390:86 , srv1112968723:86 , srv1769357811:86 , srv1859895939:86 , srv191059661:86 , srv1942040345:86 , srv1989627367:86 , srv2061497469:86 , srv2110520182:86 , srv2132514742:86 , srv415437461:86 , srv472459651:86 , srv559904996:86 , srv593098723:86 , srv761988700:86 , srv1131831602:87 , srv1146484358:87 , srv1240777436:87 , srv1270723661:87 , srv1361114052:87 , srv1391317726:87 , srv1860423650:87 , srv1903707772:87 , srv2024694404:87 , srv2025008998:87 , srv2096190698:87 , srv220595947:87 , srv273535356:87 , srv299707243:87 , srv386436673:87 , srv766903206:87 , srv847020353:87 , srv849775766:87 , srv123373505:88 , srv1303406544:88 , srv1542986485:88 , srv1620182840:88 , srv1651833786:88 , srv1986230828:88 , srv2010609187:88 , srv2032494878:88 , srv219347386:88 , srv319862274:88 , srv335806393:88 , srv523908534:88 , srv611545118:88 , srv75621434:88 , srv889767234:88 , srv947121273:88 , srv1163374247:89 , srv1753788278:89 , srv1990680479:89 , srv448620301:89 , srv1036479285:90 , srv382859328:90 , srv557949428:90 , srv908468800:90 , srv12147714:91 , srv457933619:91 , srv1239929822:92 , srv334257791:94 , srv1352908841:451 }
2024-02-05 07:53:10,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:10,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1240777436=17, srv1361114052=25, srv502472270=78, srv220595947=63, srv313205708=66, srv2041222557=55, srv593098723=85, srv901503569=95, srv1942040345=45, srv1073953314=3, srv382859328=70, srv762798811=89, srv1112968723=6, srv1270723661=19, srv273535356=64, srv847020353=92, srv1394951032=28, srv1163374247=12, srv559904996=84, srv1744177101=35, srv2122641806=60, srv319862274=67, srv1964677008=47, srv1345109208=22, srv2061497469=56, srv2110520182=59, srv472459651=76, srv761988700=88, srv2024694404=52, srv1026961198=0, srv1206969635=13, srv415437461=72, srv807360052=91, srv931317818=98, srv1986230828=48, srv519779352=80, srv611545118=86, srv12147714=14, srv766903206=90, srv334257791=68, srv1547118453=32, srv1852754657=39, srv1537064307=30, srv1786445604=38, srv1903707772=42, srv123373505=15, srv207267864=57, srv1313186500=21, srv335806393=69, srv1131831602=8, srv1239929822=16, srv1922924724=44, srv457933619=75, srv2025008998=53, srv1072004390=2, srv2096190698=58, srv557949428=82, srv908468800=96, srv2132514742=61, srv1990680479=50, srv1352778497=23, srv107904878=4, srv1859895939=40, srv1753788278=36, srv2010609187=51, srv1952664795=46, srv386436673=71, srv2032494878=54, srv947121273=99, srv1303406544=20, srv47921065=77, srv927953912=97, srv1392457630=27, srv219347386=62, srv1989627367=49, srv1651833786=34, srv523908534=81, srv75621434=87, srv1620182840=33, srv889767234=94, srv1141330019=9, srv849775766=93, srv1036479285=1, srv448620301=74, srv1122610234=7, srv1352908841=24, srv1391317726=26, srv1470982239=29, srv559756738=83, srv513831152=79, srv1542986485=31, srv1769357811=37, srv415840496=73, srv1158416249=11, srv1105707277=5, srv191059661=43, srv299707243=65, srv126570307=18, srv1860423650=41, srv1146484358=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:10,689 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:10,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:10,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-05 07:53:10,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-05 07:53:10,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-05 07:53:10,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-05 07:53:10,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-05 07:53:10,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-05 07:53:10,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-05 07:53:10,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-05 07:53:10,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-05 07:53:10,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-05 07:53:10,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-05 07:53:10,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-05 07:53:10,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04058771383102503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05146343214832109, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04058771383102503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17391666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:10,880 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-05 07:53:10,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17886192589801453, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04058771383102503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05146343214832109, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04058771383102503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17391666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24283333333333335, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-05 07:53:11,127 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 2695 regions; Going from a computed imbalance of 0.17886192589801453 to a new imbalance of 0.014344979676784992. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023062670463842774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03125866883129186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29944444444444446, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023062670463842774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:11,139 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv334257791:78 , srv1036479285:79 , srv557949428:80 , srv448620301:81 , srv457933619:81 , srv908468800:81 , srv1239929822:82 , srv12147714:83 , srv1361114052:83 , srv2025008998:83 , srv335806393:83 , srv382859328:83 , srv766903206:83 , srv847020353:83 , srv1131831602:84 , srv123373505:84 , srv1240777436:84 , srv1542986485:84 , srv1620182840:84 , srv1651833786:84 , srv1753788278:84 , srv191059661:84 , srv1989627367:84 , srv2010609187:84 , srv415437461:84 , srv75621434:84 , srv889767234:84 , srv1026961198:85 , srv1073953314:85 , srv1146484358:85 , srv1163374247:85 , srv1547118453:85 , srv1769357811:85 , srv1859895939:85 , srv1860423650:85 , srv1952664795:85 , srv1986230828:85 , srv2032494878:85 , srv2061497469:85 , srv2096190698:85 , srv2110520182:85 , srv219347386:85 , srv220595947:85 , srv523908534:85 , srv559904996:85 , srv611545118:85 , srv107904878:86 , srv1112968723:86 , srv1141330019:86 , srv126570307:86 , srv1270723661:86 , srv1303406544:86 , srv1352778497:86 , srv1391317726:86 , srv1744177101:86 , srv1903707772:86 , srv1990680479:86 , srv2024694404:86 , srv2132514742:86 , srv273535356:86 , srv319862274:86 , srv502472270:86 , srv559756738:86 , srv593098723:86 , srv761988700:86 , srv849775766:86 , srv931317818:86 , srv1072004390:87 , srv1122610234:87 , srv1206969635:87 , srv1345109208:87 , srv1394951032:87 , srv1470982239:87 , srv1786445604:87 , srv1852754657:87 , srv1922924724:87 , srv1942040345:87 , srv207267864:87 , srv2122641806:87 , srv415840496:87 , srv519779352:87 , srv807360052:87 , srv927953912:87 , srv1158416249:88 , srv1537064307:88 , srv299707243:88 , srv313205708:88 , srv386436673:88 , srv47921065:88 , srv947121273:88 , srv1105707277:89 , srv2041222557:89 , srv513831152:89 , srv762798811:89 , srv1313186500:90 , srv1964677008:90 , srv472459651:90 , srv1392457630:91 , srv901503569:91 , srv1352908841:528 }
2024-02-05 07:53:11,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:11,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1240777436=17, srv1361114052=25, srv502472270=78, srv220595947=63, srv313205708=66, srv2041222557=55, srv593098723=85, srv901503569=95, srv1942040345=45, srv1073953314=3, srv382859328=70, srv762798811=89, srv1112968723=6, srv1270723661=19, srv273535356=64, srv847020353=92, srv1394951032=28, srv1163374247=12, srv559904996=84, srv1744177101=35, srv2122641806=60, srv319862274=67, srv1964677008=47, srv1345109208=22, srv2061497469=56, srv2110520182=59, srv472459651=76, srv761988700=88, srv2024694404=52, srv1026961198=0, srv1206969635=13, srv415437461=72, srv807360052=91, srv931317818=98, srv1986230828=48, srv519779352=80, srv611545118=86, srv12147714=14, srv766903206=90, srv334257791=68, srv1547118453=32, srv1852754657=39, srv1537064307=30, srv1786445604=38, srv1903707772=42, srv123373505=15, srv207267864=57, srv1313186500=21, srv335806393=69, srv1131831602=8, srv1239929822=16, srv1922924724=44, srv457933619=75, srv2025008998=53, srv1072004390=2, srv2096190698=58, srv557949428=82, srv908468800=96, srv2132514742=61, srv1990680479=50, srv1352778497=23, srv107904878=4, srv1859895939=40, srv1753788278=36, srv2010609187=51, srv1952664795=46, srv386436673=71, srv2032494878=54, srv947121273=99, srv1303406544=20, srv47921065=77, srv927953912=97, srv1392457630=27, srv219347386=62, srv1989627367=49, srv1651833786=34, srv523908534=81, srv75621434=87, srv1620182840=33, srv889767234=94, srv1141330019=9, srv849775766=93, srv1036479285=1, srv448620301=74, srv1122610234=7, srv1352908841=24, srv1391317726=26, srv1470982239=29, srv559756738=83, srv513831152=79, srv1542986485=31, srv1769357811=37, srv415840496=73, srv1158416249=11, srv1105707277=5, srv191059661=43, srv299707243=65, srv126570307=18, srv1860423650=41, srv1146484358=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:11,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:11,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:11,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-05 07:53:11,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-05 07:53:11,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-05 07:53:11,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-05 07:53:11,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-05 07:53:11,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-05 07:53:11,163 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-05 07:53:11,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-05 07:53:11,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-05 07:53:11,332 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023062670463842774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03125866883129186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023062670463842774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:11,332 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-05 07:53:11,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014326108883451436, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023062670463842774); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03125866883129186, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023062670463842774); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011333333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-05 07:53:11,753 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 558 ms to try 5000 different iterations.  Found a solution that moves 907 regions; Going from a computed imbalance of 0.014326108883451436 to a new imbalance of 6.1213459110585E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006496135430631728); MoveCostFunction : (multiplier=7.0, imbalance=0.10077777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:11,754 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv947121273:81 , srv1990680479:82 , srv386436673:82 , srv472459651:82 , srv1072004390:83 , srv12147714:83 , srv1303406544:83 , srv299707243:83 , srv319862274:83 , srv901503569:83 , srv1146484358:84 , srv1163374247:84 , srv1239929822:84 , srv1270723661:84 , srv1345109208:84 , srv1391317726:84 , srv1392457630:84 , srv1753788278:84 , srv1942040345:84 , srv1986230828:84 , srv2024694404:84 , srv219347386:84 , srv273535356:84 , srv523908534:84 , srv611545118:84 , srv849775766:84 , srv123373505:85 , srv1537064307:85 , srv1620182840:85 , srv1651833786:85 , srv1786445604:85 , srv1903707772:85 , srv1964677008:85 , srv2010609187:85 , srv2032494878:85 , srv2041222557:85 , srv207267864:85 , srv2096190698:85 , srv2132514742:85 , srv220595947:85 , srv313205708:85 , srv334257791:85 , srv382859328:85 , srv47921065:85 , srv513831152:85 , srv593098723:85 , srv75621434:85 , srv761988700:85 , srv762798811:85 , srv889767234:85 , srv1026961198:86 , srv107904878:86 , srv1105707277:86 , srv1112968723:86 , srv1122610234:86 , srv1158416249:86 , srv1206969635:86 , srv1240777436:86 , srv1313186500:86 , srv1352778497:86 , srv1361114052:86 , srv1394951032:86 , srv1470982239:86 , srv1542986485:86 , srv1769357811:86 , srv1852754657:86 , srv1859895939:86 , srv1860423650:86 , srv1922924724:86 , srv2061497469:86 , srv2110520182:86 , srv2122641806:86 , srv335806393:86 , srv415840496:86 , srv448620301:86 , srv457933619:86 , srv807360052:86 , srv1073953314:87 , srv1131831602:87 , srv1547118453:87 , srv1744177101:87 , srv1952664795:87 , srv502472270:87 , srv519779352:87 , srv559756738:87 , srv559904996:87 , srv766903206:87 , srv847020353:87 , srv908468800:87 , srv927953912:87 , srv931317818:87 , srv1141330019:88 , srv126570307:88 , srv191059661:88 , srv1989627367:88 , srv2025008998:88 , srv415437461:88 , srv557949428:88 , srv1036479285:89 , srv1352908841:546 }
2024-02-05 07:53:11,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:11,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1240777436=17, srv1361114052=25, srv502472270=78, srv220595947=63, srv313205708=66, srv2041222557=55, srv593098723=85, srv901503569=95, srv1942040345=45, srv1073953314=3, srv382859328=70, srv762798811=89, srv1112968723=6, srv1270723661=19, srv273535356=64, srv847020353=92, srv1394951032=28, srv1163374247=12, srv559904996=84, srv1744177101=35, srv2122641806=60, srv319862274=67, srv1964677008=47, srv1345109208=22, srv2061497469=56, srv2110520182=59, srv472459651=76, srv761988700=88, srv2024694404=52, srv1026961198=0, srv1206969635=13, srv415437461=72, srv807360052=91, srv931317818=98, srv1986230828=48, srv519779352=80, srv611545118=86, srv12147714=14, srv766903206=90, srv334257791=68, srv1547118453=32, srv1852754657=39, srv1537064307=30, srv1786445604=38, srv1903707772=42, srv123373505=15, srv207267864=57, srv1313186500=21, srv335806393=69, srv1131831602=8, srv1239929822=16, srv1922924724=44, srv457933619=75, srv2025008998=53, srv1072004390=2, srv2096190698=58, srv557949428=82, srv908468800=96, srv2132514742=61, srv1990680479=50, srv1352778497=23, srv107904878=4, srv1859895939=40, srv1753788278=36, srv2010609187=51, srv1952664795=46, srv386436673=71, srv2032494878=54, srv947121273=99, srv1303406544=20, srv47921065=77, srv927953912=97, srv1392457630=27, srv219347386=62, srv1989627367=49, srv1651833786=34, srv523908534=81, srv75621434=87, srv1620182840=33, srv889767234=94, srv1141330019=9, srv849775766=93, srv1036479285=1, srv448620301=74, srv1122610234=7, srv1352908841=24, srv1391317726=26, srv1470982239=29, srv559756738=83, srv513831152=79, srv1542986485=31, srv1769357811=37, srv415840496=73, srv1158416249=11, srv1105707277=5, srv191059661=43, srv299707243=65, srv126570307=18, srv1860423650=41, srv1146484358=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:11,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:11,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-05 07:53:11,772 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-05 07:53:11,773 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-05 07:53:11,774 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-05 07:53:11,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-05 07:53:11,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-05 07:53:11,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-05 07:53:11,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-05 07:53:11,915 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006496135430631728); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:11,916 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-02-05 07:53:11,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.057836413642793E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007552451993465777); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006496135430631728); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007552451993465777); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0035); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-02-05 07:53:12,232 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 440 ms to try 5000 different iterations.  Found a solution that moves 255 regions; Going from a computed imbalance of 6.057836413642793E-4 to a new imbalance of 1.286068662571445E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.028333333333333332, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:12,233 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1313186500:83 , srv415437461:83 , srv472459651:83 , srv519779352:83 , srv1036479285:84 , srv1105707277:84 , srv1112968723:84 , srv1122610234:84 , srv1131831602:84 , srv1141330019:84 , srv1158416249:84 , srv1163374247:84 , srv1206969635:84 , srv1239929822:84 , srv126570307:84 , srv1392457630:84 , srv1394951032:84 , srv1744177101:84 , srv1903707772:84 , srv1964677008:84 , srv1989627367:84 , srv2025008998:84 , srv2032494878:84 , srv2061497469:84 , srv2096190698:84 , srv2122641806:84 , srv299707243:84 , srv415840496:84 , srv457933619:84 , srv47921065:84 , srv502472270:84 , srv557949428:84 , srv559904996:84 , srv847020353:84 , srv908468800:84 , srv927953912:84 , srv931317818:84 , srv1026961198:85 , srv1073953314:85 , srv107904878:85 , srv123373505:85 , srv1240777436:85 , srv1270723661:85 , srv1303406544:85 , srv1352778497:85 , srv1391317726:85 , srv1470982239:85 , srv1537064307:85 , srv1542986485:85 , srv1547118453:85 , srv1620182840:85 , srv1651833786:85 , srv1753788278:85 , srv1769357811:85 , srv1786445604:85 , srv1852754657:85 , srv1859895939:85 , srv1860423650:85 , srv191059661:85 , srv1922924724:85 , srv1942040345:85 , srv1986230828:85 , srv1990680479:85 , srv2010609187:85 , srv2024694404:85 , srv2041222557:85 , srv2110520182:85 , srv2132514742:85 , srv219347386:85 , srv220595947:85 , srv273535356:85 , srv313205708:85 , srv319862274:85 , srv334257791:85 , srv335806393:85 , srv382859328:85 , srv386436673:85 , srv513831152:85 , srv523908534:85 , srv559756738:85 , srv593098723:85 , srv611545118:85 , srv75621434:85 , srv761988700:85 , srv762798811:85 , srv766903206:85 , srv807360052:85 , srv849775766:85 , srv889767234:85 , srv901503569:85 , srv947121273:85 , srv1072004390:86 , srv1146484358:86 , srv12147714:86 , srv1345109208:86 , srv1361114052:86 , srv1952664795:86 , srv207267864:86 , srv448620301:86 , srv1352908841:618 }
2024-02-05 07:53:12,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:12,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1240777436=17, srv1361114052=25, srv502472270=78, srv220595947=63, srv313205708=66, srv2041222557=55, srv593098723=85, srv901503569=95, srv1942040345=45, srv1073953314=3, srv382859328=70, srv762798811=89, srv1112968723=6, srv1270723661=19, srv273535356=64, srv847020353=92, srv1394951032=28, srv1163374247=12, srv559904996=84, srv1744177101=35, srv2122641806=60, srv319862274=67, srv1964677008=47, srv1345109208=22, srv2061497469=56, srv2110520182=59, srv472459651=76, srv761988700=88, srv2024694404=52, srv1026961198=0, srv1206969635=13, srv415437461=72, srv807360052=91, srv931317818=98, srv1986230828=48, srv519779352=80, srv611545118=86, srv12147714=14, srv766903206=90, srv334257791=68, srv1547118453=32, srv1852754657=39, srv1537064307=30, srv1786445604=38, srv1903707772=42, srv123373505=15, srv207267864=57, srv1313186500=21, srv335806393=69, srv1131831602=8, srv1239929822=16, srv1922924724=44, srv457933619=75, srv2025008998=53, srv1072004390=2, srv2096190698=58, srv557949428=82, srv908468800=96, srv2132514742=61, srv1990680479=50, srv1352778497=23, srv107904878=4, srv1859895939=40, srv1753788278=36, srv2010609187=51, srv1952664795=46, srv386436673=71, srv2032494878=54, srv947121273=99, srv1303406544=20, srv47921065=77, srv927953912=97, srv1392457630=27, srv219347386=62, srv1989627367=49, srv1651833786=34, srv523908534=81, srv75621434=87, srv1620182840=33, srv889767234=94, srv1141330019=9, srv849775766=93, srv1036479285=1, srv448620301=74, srv1122610234=7, srv1352908841=24, srv1391317726=26, srv1470982239=29, srv559756738=83, srv513831152=79, srv1542986485=31, srv1769357811=37, srv415840496=73, srv1158416249=11, srv1105707277=5, srv191059661=43, srv299707243=65, srv126570307=18, srv1860423650=41, srv1146484358=10} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:12,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:12,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:12,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:12,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:12,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:12,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-02-05 07:53:12,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-02-05 07:53:12,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-02-05 07:53:12,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-02-05 07:53:12,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-02-05 07:53:12,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-02-05 07:53:12,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-02-05 07:53:12,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-02-05 07:53:12,421 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.1075138462428321E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:12,421 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1313186500:83 , srv415437461:83 , srv472459651:83 , srv519779352:83 , srv1036479285:84 , srv1105707277:84 , srv1112968723:84 , srv1122610234:84 , srv1131831602:84 , srv1141330019:84 , srv1158416249:84 , srv1163374247:84 , srv1206969635:84 , srv1239929822:84 , srv126570307:84 , srv1392457630:84 , srv1394951032:84 , srv1744177101:84 , srv1903707772:84 , srv1964677008:84 , srv1989627367:84 , srv2025008998:84 , srv2032494878:84 , srv2061497469:84 , srv2096190698:84 , srv2122641806:84 , srv299707243:84 , srv415840496:84 , srv457933619:84 , srv47921065:84 , srv502472270:84 , srv557949428:84 , srv559904996:84 , srv847020353:84 , srv908468800:84 , srv927953912:84 , srv931317818:84 , srv1026961198:85 , srv1073953314:85 , srv107904878:85 , srv123373505:85 , srv1240777436:85 , srv1270723661:85 , srv1303406544:85 , srv1352778497:85 , srv1391317726:85 , srv1470982239:85 , srv1537064307:85 , srv1542986485:85 , srv1547118453:85 , srv1620182840:85 , srv1651833786:85 , srv1753788278:85 , srv1769357811:85 , srv1786445604:85 , srv1852754657:85 , srv1859895939:85 , srv1860423650:85 , srv191059661:85 , srv1922924724:85 , srv1942040345:85 , srv1986230828:85 , srv1990680479:85 , srv2010609187:85 , srv2024694404:85 , srv2041222557:85 , srv2110520182:85 , srv2132514742:85 , srv219347386:85 , srv220595947:85 , srv273535356:85 , srv313205708:85 , srv319862274:85 , srv334257791:85 , srv335806393:85 , srv382859328:85 , srv386436673:85 , srv513831152:85 , srv523908534:85 , srv559756738:85 , srv593098723:85 , srv611545118:85 , srv75621434:85 , srv761988700:85 , srv762798811:85 , srv766903206:85 , srv807360052:85 , srv849775766:85 , srv889767234:85 , srv901503569:85 , srv947121273:85 , srv1072004390:86 , srv1146484358:86 , srv12147714:86 , srv1345109208:86 , srv1361114052:86 , srv1952664795:86 , srv207267864:86 , srv448620301:86 , srv1352908841:618 }
2024-02-05 07:53:12,467 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=378 (was 289) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=1332 (was 2183)
2024-02-05 07:53:12,477 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=378, ProcessCount=167, AvailableMemoryMB=1332
2024-02-05 07:53:12,478 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-02-05 07:53:12,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-02-05 07:53:12,491 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1143925046:84 , srv1166769240:84 , srv1297113373:84 , srv134385100:84 , srv1357058165:84 , srv1404006431:84 , srv145443022:84 , srv1493314191:84 , srv153104325:84 , srv1560643198:84 , srv1596039838:84 , srv1605739416:84 , srv1636029170:84 , srv1654538938:84 , srv1769713065:84 , srv1852848647:84 , srv19334057:84 , srv2003722288:84 , srv2080915765:84 , srv209832233:84 , srv2122060909:84 , srv36438528:84 , srv386924191:84 , srv41052696:84 , srv443534974:84 , srv496396689:84 , srv514691978:84 , srv736914957:84 , srv978260404:84 , srv663221887:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-02-05 07:53:12,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:53:12,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1404006431=5, srv2003722288=17, srv443534974=24, srv145443022=6, srv1166769240=1, srv1143925046=0, srv1493314191=7, srv134385100=3, srv36438528=21, srv978260404=29, srv386924191=22, srv1769713065=14, srv19334057=16, srv1297113373=2, srv1596039838=10, srv1636029170=12, srv1654538938=13, srv514691978=26, srv736914957=28, srv1357058165=4, srv2080915765=18, srv41052696=23, srv1560643198=9, srv209832233=19, srv2122060909=20, srv153104325=8, srv663221887=27, srv1605739416=11, srv1852848647=15, srv496396689=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:53:12,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:53:12,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:53:12,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:53:12,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:53:12,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:53:12,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-05 07:53:12,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1622221257106884, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:53:12,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912704199885354, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1622221257106884, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-02-05 07:55:12,513 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 7011496 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912704199885354 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:55:12,520 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1143925046:90 , srv1166769240:90 , srv1297113373:90 , srv134385100:90 , srv1357058165:90 , srv1404006431:90 , srv145443022:90 , srv1493314191:90 , srv153104325:90 , srv1560643198:90 , srv1596039838:90 , srv1605739416:90 , srv1636029170:90 , srv1654538938:90 , srv1769713065:90 , srv1852848647:90 , srv19334057:90 , srv2003722288:90 , srv2080915765:90 , srv209832233:90 , srv2122060909:90 , srv36438528:90 , srv386924191:90 , srv41052696:90 , srv443534974:90 , srv496396689:90 , srv514691978:90 , srv663221887:90 , srv736914957:90 , srv978260404:90 }
2024-02-05 07:55:12,521 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-02-05 07:55:12,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1404006431=5, srv2003722288=17, srv443534974=24, srv145443022=6, srv1166769240=1, srv1143925046=0, srv1493314191=7, srv134385100=3, srv36438528=21, srv978260404=29, srv386924191=22, srv1769713065=14, srv19334057=16, srv1297113373=2, srv1596039838=10, srv1636029170=12, srv1654538938=13, srv514691978=26, srv736914957=28, srv1357058165=4, srv2080915765=18, srv41052696=23, srv1560643198=9, srv209832233=19, srv2122060909=20, srv153104325=8, srv663221887=27, srv1605739416=11, srv1852848647=15, srv496396689=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-02-05 07:55:12,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-02-05 07:55:12,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-02-05 07:55:12,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-02-05 07:55:12,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-02-05 07:55:12,551 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-02-05 07:55:12,551 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1143925046:90 , srv1166769240:90 , srv1297113373:90 , srv134385100:90 , srv1357058165:90 , srv1404006431:90 , srv145443022:90 , srv1493314191:90 , srv153104325:90 , srv1560643198:90 , srv1596039838:90 , srv1605739416:90 , srv1636029170:90 , srv1654538938:90 , srv1769713065:90 , srv1852848647:90 , srv19334057:90 , srv2003722288:90 , srv2080915765:90 , srv209832233:90 , srv2122060909:90 , srv36438528:90 , srv386924191:90 , srv41052696:90 , srv443534974:90 , srv496396689:90 , srv514691978:90 , srv663221887:90 , srv736914957:90 , srv978260404:90 }
2024-02-05 07:55:12,567 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 378), ProcessCount=167 (was 167), AvailableMemoryMB=1090 (was 1332)