2023-11-19 17:55:13,884 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-19 17:55:14,168 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-19 17:55:14,275 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-19 17:55:14,334 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 17:55:14,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 17:55:14,353 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=86, ProcessCount=173, AvailableMemoryMB=15946
2023-11-19 17:55:14,355 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 17:55:14,355 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-19 17:55:14,479 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010607479:84 , srv1044199721:84 , srv1064168047:84 , srv10855412:84 , srv1108803340:84 , srv1123349830:84 , srv1158890271:84 , srv1169252834:84 , srv1200919859:84 , srv1202682774:84 , srv1212258728:84 , srv1233671386:84 , srv1257176009:84 , srv1259052071:84 , srv1277932862:84 , srv1283103228:84 , srv129430663:84 , srv1330187378:84 , srv1334574780:84 , srv1343462409:84 , srv1349202859:84 , srv1351933062:84 , srv1360011089:84 , srv1363288594:84 , srv1366891384:84 , srv1374297145:84 , srv1380047560:84 , srv1380779206:84 , srv1389222290:84 , srv1414510127:84 , srv1417581607:84 , srv1425472087:84 , srv1441412315:84 , srv1456948436:84 , srv1466958837:84 , srv1478214260:84 , srv1489851337:84 , srv1492272679:84 , srv1545492634:84 , srv1552891611:84 , srv1554339779:84 , srv1586929360:84 , srv1616376502:84 , srv1627170597:84 , srv1640613954:84 , srv1645248817:84 , srv1650237140:84 , srv1652364470:84 , srv1680745819:84 , srv1707632664:84 , srv1711027412:84 , srv1722338939:84 , srv1732829340:84 , srv1745387537:84 , srv1750576596:84 , srv1760028248:84 , srv1857824939:84 , srv1891771907:84 , srv189837804:84 , srv1906367972:84 , srv1912509653:84 , srv193376942:84 , srv1947314575:84 , srv1948055931:84 , srv196977849:84 , srv2001768496:84 , srv2002207599:84 , srv2015332253:84 , srv2042319997:84 , srv2137075441:84 , srv2144164561:84 , srv219060928:84 , srv267680378:84 , srv291289205:84 , srv303364847:84 , srv307234533:84 , srv341424035:84 , srv361877763:84 , srv395989583:84 , srv411522386:84 , srv439181111:84 , srv465552903:84 , srv503818006:84 , srv564349533:84 , srv60171981:84 , srv721676340:84 , srv734524021:84 , srv761422042:84 , srv772963482:84 , srv774301966:84 , srv780428341:84 , srv797515763:84 , srv799044126:84 , srv83018274:84 , srv846659056:84 , srv866826181:84 , srv869951750:84 , srv968001869:84 , srv978716179:84 , srv249243121:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-19 17:55:14,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:14,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:14,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:14,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:14,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:14,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:14,574 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:14,575 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:14,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:14,577 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:14,578 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:14,779 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:14,779 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 17:55:14,780 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 17:55:15,103 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 502 ms to try 5000 different iterations.  Found a solution that moves 4741 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17448501121446733. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040028360067294995, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054004613844544025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5267777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040028360067294995, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1695, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:15,126 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1374297145:81 , srv503818006:81 , srv10855412:82 , srv1760028248:82 , srv2137075441:82 , srv219060928:82 , srv1947314575:83 , srv395989583:83 , srv1158890271:84 , srv1351933062:84 , srv1363288594:84 , srv1380047560:84 , srv1414510127:84 , srv1466958837:84 , srv1586929360:84 , srv1722338939:84 , srv439181111:84 , srv1064168047:85 , srv1343462409:85 , srv1389222290:85 , srv1456948436:85 , srv1554339779:85 , srv1680745819:85 , srv1750576596:85 , srv193376942:85 , srv2144164561:85 , srv291289205:85 , srv361877763:85 , srv411522386:85 , srv772963482:85 , srv774301966:85 , srv968001869:85 , srv1044199721:86 , srv1169252834:86 , srv1212258728:86 , srv1349202859:86 , srv1380779206:86 , srv1441412315:86 , srv1478214260:86 , srv1545492634:86 , srv1616376502:86 , srv1627170597:86 , srv1707632664:86 , srv1745387537:86 , srv1912509653:86 , srv196977849:86 , srv2001768496:86 , srv267680378:86 , srv307234533:86 , srv341424035:86 , srv465552903:86 , srv60171981:86 , srv1259052071:87 , srv1277932862:87 , srv1330187378:87 , srv1334574780:87 , srv1366891384:87 , srv1417581607:87 , srv1489851337:87 , srv1492272679:87 , srv1552891611:87 , srv1906367972:87 , srv2002207599:87 , srv2042319997:87 , srv721676340:87 , srv734524021:87 , srv780428341:87 , srv83018274:87 , srv866826181:87 , srv1108803340:88 , srv1123349830:88 , srv1233671386:88 , srv129430663:88 , srv1360011089:88 , srv1425472087:88 , srv1645248817:88 , srv1650237140:88 , srv1652364470:88 , srv1891771907:88 , srv303364847:88 , srv761422042:88 , srv978716179:88 , srv1010607479:89 , srv1283103228:89 , srv1732829340:89 , srv1857824939:89 , srv564349533:89 , srv799044126:89 , srv846659056:89 , srv869951750:89 , srv1200919859:90 , srv1202682774:90 , srv1711027412:90 , srv189837804:90 , srv1948055931:90 , srv2015332253:90 , srv797515763:90 , srv1257176009:91 , srv1640613954:91 , srv249243121:446 }
2023-11-19 17:55:15,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:15,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:15,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:15,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:15,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:15,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:15,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:15,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:15,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040028360067294995, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054004613844544025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040028360067294995, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1695, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:15,288 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 17:55:15,288 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1744518140229295, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040028360067294995, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.054004613844544025, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040028360067294995, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1695, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23791666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 17:55:15,546 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 361 ms to try 5000 different iterations.  Found a solution that moves 2626 regions; Going from a computed imbalance of 0.1744518140229295 to a new imbalance of 0.013917308786657676. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020821751363457063); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030421653343361516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2917777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020821751363457063); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:15,566 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010607479:81 , srv1202682774:81 , srv1948055931:81 , srv564349533:81 , srv1257176009:82 , srv1283103228:82 , srv1360011089:82 , srv1640613954:82 , srv1711027412:82 , srv1891771907:82 , srv2015332253:82 , srv797515763:82 , srv799044126:82 , srv1233671386:83 , srv1732829340:83 , srv1857824939:83 , srv189837804:83 , srv1044199721:84 , srv1108803340:84 , srv1169252834:84 , srv1200919859:84 , srv129430663:84 , srv1330187378:84 , srv1441412315:84 , srv1552891611:84 , srv1650237140:84 , srv303364847:84 , srv761422042:84 , srv83018274:84 , srv1123349830:85 , srv1334574780:85 , srv1349202859:85 , srv1425472087:85 , srv1478214260:85 , srv1645248817:85 , srv1652364470:85 , srv193376942:85 , srv2001768496:85 , srv2002207599:85 , srv2042319997:85 , srv307234533:85 , srv411522386:85 , srv734524021:85 , srv772963482:85 , srv774301966:85 , srv869951750:85 , srv1158890271:86 , srv1212258728:86 , srv1380779206:86 , srv1414510127:86 , srv1417581607:86 , srv1492272679:86 , srv1680745819:86 , srv1745387537:86 , srv1912509653:86 , srv2144164561:86 , srv267680378:86 , srv341424035:86 , srv465552903:86 , srv780428341:86 , srv846659056:86 , srv1277932862:87 , srv1343462409:87 , srv1351933062:87 , srv1363288594:87 , srv1366891384:87 , srv1489851337:87 , srv1545492634:87 , srv1554339779:87 , srv1616376502:87 , srv1627170597:87 , srv1707632664:87 , srv1906367972:87 , srv196977849:87 , srv439181111:87 , srv60171981:87 , srv721676340:87 , srv866826181:87 , srv978716179:87 , srv1064168047:88 , srv10855412:88 , srv1259052071:88 , srv1456948436:88 , srv1466958837:88 , srv291289205:88 , srv1380047560:89 , srv1389222290:89 , srv1722338939:89 , srv1760028248:89 , srv1947314575:89 , srv219060928:89 , srv395989583:89 , srv1750576596:90 , srv2137075441:90 , srv361877763:90 , srv503818006:90 , srv968001869:90 , srv1586929360:91 , srv1374297145:92 , srv249243121:513 }
2023-11-19 17:55:15,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:15,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:15,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:15,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:15,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:15,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:15,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:15,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:15,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:15,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:15,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:15,732 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020821751363457063); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030421653343361516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020821751363457063); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:15,733 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 17:55:15,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013898921141650658, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020821751363457063); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030421653343361516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020821751363457063); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 17:55:15,978 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 352 ms to try 5000 different iterations.  Found a solution that moves 1022 regions; Going from a computed imbalance of 0.013898921141650658 to a new imbalance of 5.314752845444827E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005422652739987697); MoveCostFunction : (multiplier=7.0, imbalance=0.11355555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:15,980 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1200919859:83 , srv1259052071:83 , srv1277932862:83 , srv1586929360:83 , srv1750576596:83 , srv721676340:83 , srv846659056:83 , srv968001869:83 , srv1064168047:84 , srv1123349830:84 , srv1257176009:84 , srv1366891384:84 , srv1380047560:84 , srv1389222290:84 , srv1417581607:84 , srv1425472087:84 , srv1456948436:84 , srv1489851337:84 , srv1492272679:84 , srv1627170597:84 , srv1640613954:84 , srv1906367972:84 , srv361877763:84 , srv761422042:84 , srv866826181:84 , srv978716179:84 , srv129430663:85 , srv1334574780:85 , srv1374297145:85 , srv1380779206:85 , srv1554339779:85 , srv1616376502:85 , srv1650237140:85 , srv1652364470:85 , srv1707632664:85 , srv1711027412:85 , srv1722338939:85 , srv1745387537:85 , srv189837804:85 , srv1947314575:85 , srv196977849:85 , srv2002207599:85 , srv2042319997:85 , srv2137075441:85 , srv60171981:85 , srv780428341:85 , srv797515763:85 , srv869951750:85 , srv1108803340:86 , srv1202682774:86 , srv1212258728:86 , srv1283103228:86 , srv1330187378:86 , srv1343462409:86 , srv1349202859:86 , srv1363288594:86 , srv1466958837:86 , srv1545492634:86 , srv1552891611:86 , srv1645248817:86 , srv1680745819:86 , srv1732829340:86 , srv1760028248:86 , srv1857824939:86 , srv1912509653:86 , srv2015332253:86 , srv219060928:86 , srv267680378:86 , srv291289205:86 , srv303364847:86 , srv307234533:86 , srv341424035:86 , srv395989583:86 , srv439181111:86 , srv465552903:86 , srv503818006:86 , srv83018274:86 , srv1010607479:87 , srv1158890271:87 , srv1233671386:87 , srv1351933062:87 , srv1414510127:87 , srv1441412315:87 , srv1948055931:87 , srv2001768496:87 , srv2144164561:87 , srv734524021:87 , srv799044126:87 , srv1044199721:88 , srv10855412:88 , srv1169252834:88 , srv1360011089:88 , srv1478214260:88 , srv1891771907:88 , srv193376942:88 , srv411522386:88 , srv564349533:88 , srv772963482:88 , srv774301966:88 , srv249243121:535 }
2023-11-19 17:55:15,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:15,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:15,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:15,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:15,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:15,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:16,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:16,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:16,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:16,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:16,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:16,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:16,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:16,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005422652739987697); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:16,108 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 17:55:16,108 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.243190875920184E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.004103049699311091); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005422652739987697); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.004103049699311091); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 17:55:16,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 483 ms to try 5000 different iterations.  Found a solution that moves 226 regions; Going from a computed imbalance of 5.243190875920184E-4 to a new imbalance of 3.3791306412443394E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.025111111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:16,499 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1366891384:83 , srv1478214260:83 , srv1545492634:83 , srv1645248817:83 , srv291289205:83 , srv361877763:83 , srv411522386:83 , srv564349533:83 , srv734524021:83 , srv869951750:83 , srv10855412:84 , srv1108803340:84 , srv1169252834:84 , srv1212258728:84 , srv1233671386:84 , srv1259052071:84 , srv129430663:84 , srv1343462409:84 , srv1351933062:84 , srv1360011089:84 , srv1374297145:84 , srv1389222290:84 , srv1466958837:84 , srv1489851337:84 , srv1554339779:84 , srv1586929360:84 , srv1616376502:84 , srv1707632664:84 , srv1722338939:84 , srv1732829340:84 , srv1750576596:84 , srv1857824939:84 , srv1891771907:84 , srv189837804:84 , srv1906367972:84 , srv1912509653:84 , srv193376942:84 , srv1948055931:84 , srv196977849:84 , srv2001768496:84 , srv2015332253:84 , srv2144164561:84 , srv267680378:84 , srv303364847:84 , srv341424035:84 , srv395989583:84 , srv503818006:84 , srv60171981:84 , srv772963482:84 , srv774301966:84 , srv780428341:84 , srv797515763:84 , srv799044126:84 , srv846659056:84 , srv866826181:84 , srv968001869:84 , srv978716179:84 , srv1010607479:85 , srv1044199721:85 , srv1064168047:85 , srv1123349830:85 , srv1200919859:85 , srv1202682774:85 , srv1257176009:85 , srv1277932862:85 , srv1283103228:85 , srv1330187378:85 , srv1334574780:85 , srv1349202859:85 , srv1363288594:85 , srv1380047560:85 , srv1380779206:85 , srv1414510127:85 , srv1417581607:85 , srv1425472087:85 , srv1441412315:85 , srv1456948436:85 , srv1492272679:85 , srv1552891611:85 , srv1627170597:85 , srv1640613954:85 , srv1650237140:85 , srv1652364470:85 , srv1680745819:85 , srv1711027412:85 , srv1745387537:85 , srv1760028248:85 , srv1947314575:85 , srv2002207599:85 , srv2042319997:85 , srv2137075441:85 , srv219060928:85 , srv307234533:85 , srv465552903:85 , srv721676340:85 , srv83018274:85 , srv1158890271:86 , srv439181111:86 , srv761422042:86 , srv249243121:649 }
2023-11-19 17:55:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:16,522 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:16,523 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:16,524 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:16,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:16,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:16,676 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-19 17:55:16,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2208820589295686E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-19 17:55:16,944 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 403 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.2208820589295686E-5 to a new imbalance of 5.419993616711265E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:16,945 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1044199721:83 , srv1158890271:83 , srv1652364470:83 , srv439181111:83 , srv465552903:83 , srv978716179:83 , srv1010607479:84 , srv1064168047:84 , srv10855412:84 , srv1108803340:84 , srv1123349830:84 , srv1169252834:84 , srv1200919859:84 , srv1202682774:84 , srv1212258728:84 , srv1233671386:84 , srv1257176009:84 , srv1259052071:84 , srv1277932862:84 , srv1283103228:84 , srv1330187378:84 , srv1334574780:84 , srv1343462409:84 , srv1349202859:84 , srv1351933062:84 , srv1360011089:84 , srv1363288594:84 , srv1374297145:84 , srv1380047560:84 , srv1380779206:84 , srv1389222290:84 , srv1414510127:84 , srv1417581607:84 , srv1425472087:84 , srv1441412315:84 , srv1456948436:84 , srv1466958837:84 , srv1478214260:84 , srv1489851337:84 , srv1492272679:84 , srv1545492634:84 , srv1552891611:84 , srv1586929360:84 , srv1616376502:84 , srv1627170597:84 , srv1640613954:84 , srv1645248817:84 , srv1650237140:84 , srv1680745819:84 , srv1707632664:84 , srv1711027412:84 , srv1722338939:84 , srv1732829340:84 , srv1745387537:84 , srv1750576596:84 , srv1760028248:84 , srv1857824939:84 , srv1891771907:84 , srv189837804:84 , srv1906367972:84 , srv1912509653:84 , srv193376942:84 , srv1947314575:84 , srv1948055931:84 , srv196977849:84 , srv2001768496:84 , srv2002207599:84 , srv2015332253:84 , srv2042319997:84 , srv2137075441:84 , srv2144164561:84 , srv219060928:84 , srv267680378:84 , srv291289205:84 , srv303364847:84 , srv307234533:84 , srv341424035:84 , srv361877763:84 , srv395989583:84 , srv60171981:84 , srv721676340:84 , srv734524021:84 , srv761422042:84 , srv772963482:84 , srv774301966:84 , srv780428341:84 , srv799044126:84 , srv83018274:84 , srv846659056:84 , srv866826181:84 , srv869951750:84 , srv968001869:84 , srv129430663:85 , srv1366891384:85 , srv1554339779:85 , srv411522386:85 , srv503818006:85 , srv564349533:85 , srv797515763:85 , srv249243121:683 }
2023-11-19 17:55:16,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:16,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010607479=0, srv761422042=88, srv1277932862=14, srv1745387537=53, srv1351933062=21, srv1760028248=55, srv1750576596=54, srv196977849=64, srv1891771907=57, srv1123349830=5, srv129430663=16, srv1334574780=18, srv1645248817=45, srv2042319997=68, srv774301966=90, srv60171981=85, srv1360011089=22, srv249243121=72, srv1640613954=44, srv1722338939=51, srv267680378=73, srv1466958837=34, srv1202682774=9, srv1711027412=50, srv1200919859=8, srv797515763=92, srv1380047560=26, srv1212258728=10, srv1545492634=38, srv866826181=96, srv1257176009=12, srv503818006=83, srv1552891611=39, srv1586929360=41, srv307234533=76, srv1233671386=11, srv564349533=84, srv1108803340=4, srv193376942=61, srv83018274=94, srv1169252834=7, srv219060928=71, srv1380779206=27, srv1489851337=36, srv1554339779=40, srv780428341=91, srv1044199721=1, srv1492272679=37, srv2002207599=66, srv10855412=3, srv411522386=80, srv869951750=97, srv1259052071=13, srv1363288594=23, srv734524021=87, srv303364847=75, srv1417581607=30, srv395989583=79, srv1064168047=2, srv1441412315=32, srv2137075441=69, srv772963482=89, srv2144164561=70, srv1906367972=59, srv1616376502=42, srv2015332253=67, srv1343462409=19, srv1680745819=48, srv439181111=81, srv1650237140=46, srv846659056=95, srv1947314575=62, srv1414510127=29, srv341424035=77, srv968001869=98, srv799044126=93, srv1912509653=60, srv1330187378=17, srv1707632664=49, srv1478214260=35, srv1857824939=56, srv291289205=74, srv465552903=82, srv1425472087=31, srv1283103228=15, srv361877763=78, srv1366891384=24, srv1158890271=6, srv1948055931=63, srv721676340=86, srv1374297145=25, srv978716179=99, srv1627170597=43, srv1349202859=20, srv2001768496=65, srv1732829340=52, srv189837804=58, srv1389222290=28, srv1456948436=33, srv1652364470=47} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:16,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:16,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-19 17:55:16,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-19 17:55:16,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-19 17:55:16,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-19 17:55:16,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-19 17:55:16,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-19 17:55:16,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-19 17:55:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-19 17:55:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-19 17:55:16,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-19 17:55:17,090 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.223933426232788E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0011605177063713189); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:17,091 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1044199721:83 , srv1158890271:83 , srv1652364470:83 , srv439181111:83 , srv465552903:83 , srv978716179:83 , srv1010607479:84 , srv1064168047:84 , srv10855412:84 , srv1108803340:84 , srv1123349830:84 , srv1169252834:84 , srv1200919859:84 , srv1202682774:84 , srv1212258728:84 , srv1233671386:84 , srv1257176009:84 , srv1259052071:84 , srv1277932862:84 , srv1283103228:84 , srv1330187378:84 , srv1334574780:84 , srv1343462409:84 , srv1349202859:84 , srv1351933062:84 , srv1360011089:84 , srv1363288594:84 , srv1374297145:84 , srv1380047560:84 , srv1380779206:84 , srv1389222290:84 , srv1414510127:84 , srv1417581607:84 , srv1425472087:84 , srv1441412315:84 , srv1456948436:84 , srv1466958837:84 , srv1478214260:84 , srv1489851337:84 , srv1492272679:84 , srv1545492634:84 , srv1552891611:84 , srv1586929360:84 , srv1616376502:84 , srv1627170597:84 , srv1640613954:84 , srv1645248817:84 , srv1650237140:84 , srv1680745819:84 , srv1707632664:84 , srv1711027412:84 , srv1722338939:84 , srv1732829340:84 , srv1745387537:84 , srv1750576596:84 , srv1760028248:84 , srv1857824939:84 , srv1891771907:84 , srv189837804:84 , srv1906367972:84 , srv1912509653:84 , srv193376942:84 , srv1947314575:84 , srv1948055931:84 , srv196977849:84 , srv2001768496:84 , srv2002207599:84 , srv2015332253:84 , srv2042319997:84 , srv2137075441:84 , srv2144164561:84 , srv219060928:84 , srv267680378:84 , srv291289205:84 , srv303364847:84 , srv307234533:84 , srv341424035:84 , srv361877763:84 , srv395989583:84 , srv60171981:84 , srv721676340:84 , srv734524021:84 , srv761422042:84 , srv772963482:84 , srv774301966:84 , srv780428341:84 , srv799044126:84 , srv83018274:84 , srv846659056:84 , srv866826181:84 , srv869951750:84 , srv968001869:84 , srv129430663:85 , srv1366891384:85 , srv1554339779:85 , srv411522386:85 , srv503818006:85 , srv564349533:85 , srv797515763:85 , srv249243121:683 }
2023-11-19 17:55:17,114 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=86 (was 86), ProcessCount=173 (was 173), AvailableMemoryMB=15438 (was 15946)
2023-11-19 17:55:17,121 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=86, ProcessCount=173, AvailableMemoryMB=15438
2023-11-19 17:55:17,122 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-19 17:55:17,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-19 17:55:17,130 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1072593975:84 , srv1092175140:84 , srv1104168686:84 , srv1115679731:84 , srv1379556952:84 , srv1415447276:84 , srv1419304291:84 , srv1596217166:84 , srv1628917301:84 , srv1660869150:84 , srv1856818010:84 , srv1895188655:84 , srv2007725773:84 , srv2039925947:84 , srv214602185:84 , srv250596843:84 , srv398062454:84 , srv414376248:84 , srv500607988:84 , srv591071404:84 , srv66917991:84 , srv727216779:84 , srv776731075:84 , srv811119730:84 , srv824672938:84 , srv874982118:84 , srv926274364:84 , srv948750506:84 , srv98832394:84 , srv1557755920:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-19 17:55:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:55:17,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv591071404=20, srv1419304291=6, srv727216779=22, srv250596843=16, srv1104168686=2, srv500607988=19, srv414376248=18, srv874982118=26, srv1072593975=0, srv1379556952=4, srv2039925947=14, srv811119730=24, srv926274364=27, srv66917991=21, srv98832394=29, srv1628917301=9, srv2007725773=13, srv1660869150=10, srv824672938=25, srv1115679731=3, srv214602185=15, srv1092175140=1, srv1557755920=7, srv1415447276=5, srv398062454=17, srv1596217166=8, srv1856818010=11, srv1895188655=12, srv776731075=23, srv948750506=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:55:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:55:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:55:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:55:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:55:17,139 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:55:17,140 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:55:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:55:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:55:17,141 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 17:55:17,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1406796126768068, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:55:17,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912636320130213, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1406796126768068, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-19 17:57:17,144 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5561361 different iterations.  Found a solution that moves 1870 regions; Going from a computed imbalance of 0.9912636320130213 to a new imbalance of 4.3646732880327594E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6925925925925925, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:57:17,151 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1072593975:90 , srv1092175140:90 , srv1104168686:90 , srv1115679731:90 , srv1379556952:90 , srv1415447276:90 , srv1419304291:90 , srv1557755920:90 , srv1596217166:90 , srv1628917301:90 , srv1660869150:90 , srv1856818010:90 , srv1895188655:90 , srv2007725773:90 , srv2039925947:90 , srv214602185:90 , srv250596843:90 , srv398062454:90 , srv414376248:90 , srv500607988:90 , srv591071404:90 , srv66917991:90 , srv727216779:90 , srv776731075:90 , srv811119730:90 , srv824672938:90 , srv874982118:90 , srv926274364:90 , srv948750506:90 , srv98832394:90 }
2023-11-19 17:57:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-19 17:57:17,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv591071404=20, srv1419304291=6, srv727216779=22, srv250596843=16, srv1104168686=2, srv500607988=19, srv414376248=18, srv874982118=26, srv1072593975=0, srv1379556952=4, srv2039925947=14, srv811119730=24, srv926274364=27, srv66917991=21, srv98832394=29, srv1628917301=9, srv2007725773=13, srv1660869150=10, srv824672938=25, srv1115679731=3, srv214602185=15, srv1092175140=1, srv1557755920=7, srv1415447276=5, srv398062454=17, srv1596217166=8, srv1856818010=11, srv1895188655=12, srv776731075=23, srv948750506=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-19 17:57:17,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-19 17:57:17,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-19 17:57:17,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-19 17:57:17,173 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-19 17:57:17,173 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1072593975:90 , srv1092175140:90 , srv1104168686:90 , srv1115679731:90 , srv1379556952:90 , srv1415447276:90 , srv1419304291:90 , srv1557755920:90 , srv1596217166:90 , srv1628917301:90 , srv1660869150:90 , srv1856818010:90 , srv1895188655:90 , srv2007725773:90 , srv2039925947:90 , srv214602185:90 , srv250596843:90 , srv398062454:90 , srv414376248:90 , srv500607988:90 , srv591071404:90 , srv66917991:90 , srv727216779:90 , srv776731075:90 , srv811119730:90 , srv824672938:90 , srv874982118:90 , srv926274364:90 , srv948750506:90 , srv98832394:90 }
2023-11-19 17:57:17,185 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 86) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 173), AvailableMemoryMB=15328 (was 15438)