2023-07-24 06:53:13,020 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-24 06:53:13,334 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-24 06:53:13,452 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-24 06:53:13,520 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 06:53:13,529 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 06:53:13,544 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=176, AvailableMemoryMB=10379
2023-07-24 06:53:13,547 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 06:53:13,547 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-24 06:53:13,698 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004141674:84 , srv101202904:84 , srv1039729211:84 , srv1043300779:84 , srv1055104381:84 , srv1058656946:84 , srv1061373980:84 , srv108963571:84 , srv1093731162:84 , srv1099524318:84 , srv1135846767:84 , srv1152730652:84 , srv1188540189:84 , srv1208526088:84 , srv1209161108:84 , srv1274770238:84 , srv1274775511:84 , srv1280889016:84 , srv1288997427:84 , srv1293079789:84 , srv1315852220:84 , srv1333024274:84 , srv1352161119:84 , srv1376424101:84 , srv1380758936:84 , srv1391640077:84 , srv1423465445:84 , srv1434585311:84 , srv145654355:84 , srv1512748641:84 , srv1528800373:84 , srv1531832098:84 , srv1533261977:84 , srv1534426438:84 , srv1540498770:84 , srv1550172549:84 , srv1554314253:84 , srv1597187615:84 , srv1597664219:84 , srv1620809243:84 , srv162823067:84 , srv1632235002:84 , srv1655336676:84 , srv1655388782:84 , srv1659993636:84 , srv1662834876:84 , srv1750133365:84 , srv1761891222:84 , srv1765760544:84 , srv182666314:84 , srv1848463941:84 , srv1865849452:84 , srv1899261082:84 , srv1917955008:84 , srv1965603091:84 , srv1965686121:84 , srv1975933103:84 , srv1993262465:84 , srv2044030271:84 , srv2095260523:84 , srv2106754992:84 , srv2125958762:84 , srv214257697:84 , srv231575987:84 , srv235681894:84 , srv250132375:84 , srv275354198:84 , srv290791528:84 , srv316765477:84 , srv357167871:84 , srv359850446:84 , srv364428049:84 , srv386198510:84 , srv393622295:84 , srv408511955:84 , srv422947609:84 , srv438157519:84 , srv455908053:84 , srv470941460:84 , srv556325354:84 , srv569618673:84 , srv582232481:84 , srv59389388:84 , srv635241073:84 , srv64673953:84 , srv690665929:84 , srv711485854:84 , srv726020055:84 , srv73197421:84 , srv738869237:84 , srv771349743:84 , srv876326874:84 , srv895748243:84 , srv909722785:84 , srv915310890:84 , srv91650368:84 , srv930510154:84 , srv946615783:84 , srv950690737:84 , srv1298053238:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-24 06:53:13,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:13,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:13,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:13,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:13,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:13,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:13,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:13,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:13,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:13,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:13,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:13,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:13,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:13,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:14,005 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:14,006 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 06:53:14,006 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 06:53:14,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 547 ms to try 5000 different iterations.  Found a solution that moves 4700 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1815003140465064. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039404787133463175, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05821320001033547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5222222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039404787133463175, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:14,404 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv895748243:80 , srv1039729211:82 , srv1352161119:82 , srv1391640077:82 , srv1662834876:82 , srv1965603091:82 , srv711485854:82 , srv1043300779:83 , srv1333024274:83 , srv1423465445:83 , srv1533261977:83 , srv1540498770:83 , srv1899261082:83 , srv214257697:83 , srv290791528:83 , srv470941460:83 , srv64673953:83 , srv950690737:83 , srv1099524318:84 , srv1208526088:84 , srv1434585311:84 , srv182666314:84 , srv316765477:84 , srv357167871:84 , srv909722785:84 , srv915310890:84 , srv91650368:84 , srv1152730652:85 , srv1288997427:85 , srv1380758936:85 , srv1659993636:85 , srv1761891222:85 , srv1765760544:85 , srv2095260523:85 , srv235681894:85 , srv438157519:85 , srv556325354:85 , srv635241073:85 , srv108963571:86 , srv1274775511:86 , srv1528800373:86 , srv1534426438:86 , srv1597187615:86 , srv162823067:86 , srv1917955008:86 , srv1965686121:86 , srv1993262465:86 , srv2044030271:86 , srv738869237:86 , srv1004141674:87 , srv1058656946:87 , srv1209161108:87 , srv1280889016:87 , srv1315852220:87 , srv145654355:87 , srv1531832098:87 , srv1620809243:87 , srv1848463941:87 , srv250132375:87 , srv386198510:87 , srv393622295:87 , srv422947609:87 , srv930510154:87 , srv101202904:88 , srv1274770238:88 , srv1293079789:88 , srv1655336676:88 , srv1750133365:88 , srv1975933103:88 , srv2106754992:88 , srv231575987:88 , srv408511955:88 , srv455908053:88 , srv690665929:88 , srv771349743:88 , srv1055104381:89 , srv1093731162:89 , srv1376424101:89 , srv1512748641:89 , srv1655388782:89 , srv2125958762:89 , srv275354198:89 , srv582232481:89 , srv876326874:89 , srv1061373980:90 , srv1188540189:90 , srv1554314253:90 , srv359850446:90 , srv569618673:90 , srv59389388:90 , srv726020055:90 , srv73197421:90 , srv1597664219:91 , srv1632235002:91 , srv1865849452:91 , srv946615783:91 , srv1135846767:92 , srv364428049:93 , srv1550172549:94 , srv1298053238:440 }
2023-07-24 06:53:14,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:14,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:14,438 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:14,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:14,439 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:14,440 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:14,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:14,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:14,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:14,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:14,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:14,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:14,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:14,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:14,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:14,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:14,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:14,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:14,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:14,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:14,578 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039404787133463175, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05821320001033547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039404787133463175, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:14,578 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 06:53:14,579 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1814674039431047, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039404787133463175, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05821320001033547, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039404787133463175, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24066666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 06:53:14,935 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 465 ms to try 5000 different iterations.  Found a solution that moves 2645 regions; Going from a computed imbalance of 0.1814674039431047 to a new imbalance of 0.01823576722903868. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02126912334655952); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03427622657459601, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29388888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02126912334655952); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:14,956 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1550172549:78 , srv1632235002:79 , srv364428049:79 , srv1061373980:80 , srv1188540189:80 , srv1865849452:80 , srv59389388:80 , srv1055104381:81 , srv1135846767:81 , srv359850446:81 , srv876326874:81 , srv1093731162:82 , srv1293079789:82 , srv1376424101:82 , srv1512748641:82 , srv2125958762:82 , srv771349743:82 , srv946615783:82 , srv1531832098:83 , srv1554314253:83 , srv1597664219:83 , srv1655388782:83 , srv1750133365:83 , srv1274770238:84 , srv145654355:84 , srv1655336676:84 , srv2106754992:84 , srv275354198:84 , srv455908053:84 , srv569618673:84 , srv726020055:84 , srv73197421:84 , srv101202904:85 , srv1209161108:85 , srv1274775511:85 , srv1280889016:85 , srv1315852220:85 , srv1965686121:85 , srv1975933103:85 , srv235681894:85 , srv635241073:85 , srv930510154:85 , srv1004141674:86 , srv1058656946:86 , srv108963571:86 , srv162823067:86 , srv1659993636:86 , srv2044030271:86 , srv231575987:86 , srv250132375:86 , srv393622295:86 , srv408511955:86 , srv422947609:86 , srv438157519:86 , srv556325354:86 , srv738869237:86 , srv1152730652:87 , srv1423465445:87 , srv1434585311:87 , srv1528800373:87 , srv1597187615:87 , srv1620809243:87 , srv1761891222:87 , srv1765760544:87 , srv1848463941:87 , srv1917955008:87 , srv2095260523:87 , srv386198510:87 , srv582232481:87 , srv690665929:87 , srv711485854:87 , srv1043300779:88 , srv1208526088:88 , srv1352161119:88 , srv1534426438:88 , srv182666314:88 , srv1899261082:88 , srv1965603091:88 , srv91650368:88 , srv1039729211:89 , srv1099524318:89 , srv1288997427:89 , srv1333024274:89 , srv1380758936:89 , srv1391640077:89 , srv1533261977:89 , srv1540498770:89 , srv1662834876:89 , srv1993262465:89 , srv214257697:89 , srv316765477:89 , srv357167871:89 , srv909722785:89 , srv915310890:89 , srv290791528:90 , srv64673953:90 , srv470941460:91 , srv950690737:91 , srv895748243:92 , srv1298053238:523 }
2023-07-24 06:53:14,962 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:14,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:14,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:14,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:14,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:14,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:14,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:14,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:14,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:14,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:14,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:14,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:15,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02126912334655952); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03427622657459601, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02126912334655952); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:15,178 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 06:53:15,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.018217246543188126, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02126912334655952); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03427622657459601, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02126912334655952); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04783333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 06:53:15,523 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 498 ms to try 5000 different iterations.  Found a solution that moves 1021 regions; Going from a computed imbalance of 0.018217246543188126 to a new imbalance of 7.365890038039331E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00587308087272118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.11344444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00587308087272118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:15,525 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1993262465:82 , srv582232481:82 , srv1380758936:83 , srv1620809243:83 , srv470941460:83 , srv726020055:83 , srv73197421:83 , srv1004141674:84 , srv101202904:84 , srv1058656946:84 , srv1288997427:84 , srv1528800373:84 , srv1534426438:84 , srv1554314253:84 , srv1597187615:84 , srv1597664219:84 , srv1848463941:84 , srv2106754992:84 , srv231575987:84 , srv290791528:84 , srv357167871:84 , srv386198510:84 , srv408511955:84 , srv422947609:84 , srv569618673:84 , srv64673953:84 , srv690665929:84 , srv909722785:84 , srv950690737:84 , srv108963571:85 , srv1099524318:85 , srv1315852220:85 , srv1333024274:85 , srv1550172549:85 , srv162823067:85 , srv1655336676:85 , srv1761891222:85 , srv1765760544:85 , srv1917955008:85 , srv1975933103:85 , srv2095260523:85 , srv214257697:85 , srv250132375:85 , srv275354198:85 , srv316765477:85 , srv364428049:85 , srv393622295:85 , srv455908053:85 , srv915310890:85 , srv91650368:85 , srv930510154:85 , srv946615783:85 , srv1039729211:86 , srv1043300779:86 , srv1093731162:86 , srv1135846767:86 , srv1152730652:86 , srv1208526088:86 , srv1209161108:86 , srv1274770238:86 , srv1274775511:86 , srv1280889016:86 , srv1391640077:86 , srv1434585311:86 , srv1512748641:86 , srv1540498770:86 , srv1655388782:86 , srv1659993636:86 , srv1662834876:86 , srv1865849452:86 , srv1899261082:86 , srv2044030271:86 , srv2125958762:86 , srv438157519:86 , srv556325354:86 , srv738869237:86 , srv895748243:86 , srv1188540189:87 , srv1293079789:87 , srv1376424101:87 , srv1423465445:87 , srv145654355:87 , srv1533261977:87 , srv1632235002:87 , srv1750133365:87 , srv182666314:87 , srv1965603091:87 , srv1965686121:87 , srv235681894:87 , srv359850446:87 , srv59389388:87 , srv771349743:87 , srv1055104381:88 , srv1061373980:88 , srv1352161119:88 , srv1531832098:88 , srv635241073:88 , srv711485854:88 , srv876326874:88 , srv1298053238:547 }
2023-07-24 06:53:15,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:15,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:15,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:15,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:15,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:15,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:15,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:15,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:15,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:15,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00587308087272118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00587308087272118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:15,676 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 06:53:15,676 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.294398090011287E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00587308087272118); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005763774795025093); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00587308087272118); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 06:53:16,057 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 487 ms to try 5000 different iterations.  Found a solution that moves 239 regions; Going from a computed imbalance of 7.294398090011287E-4 to a new imbalance of 5.148090303264699E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.026555555555555554, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:16,058 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1135846767:83 , srv1274770238:83 , srv1376424101:83 , srv1533261977:83 , srv1540498770:83 , srv1965686121:83 , srv635241073:83 , srv1004141674:84 , srv1055104381:84 , srv1061373980:84 , srv1099524318:84 , srv1152730652:84 , srv1208526088:84 , srv1209161108:84 , srv1280889016:84 , srv1288997427:84 , srv1333024274:84 , srv145654355:84 , srv1531832098:84 , srv1534426438:84 , srv1597664219:84 , srv1655388782:84 , srv182666314:84 , srv1848463941:84 , srv1865849452:84 , srv1917955008:84 , srv1965603091:84 , srv1975933103:84 , srv2044030271:84 , srv231575987:84 , srv250132375:84 , srv275354198:84 , srv316765477:84 , srv359850446:84 , srv386198510:84 , srv393622295:84 , srv569618673:84 , srv582232481:84 , srv690665929:84 , srv726020055:84 , srv738869237:84 , srv876326874:84 , srv895748243:84 , srv915310890:84 , srv946615783:84 , srv950690737:84 , srv101202904:85 , srv1039729211:85 , srv1043300779:85 , srv1058656946:85 , srv108963571:85 , srv1093731162:85 , srv1188540189:85 , srv1274775511:85 , srv1293079789:85 , srv1315852220:85 , srv1352161119:85 , srv1380758936:85 , srv1423465445:85 , srv1434585311:85 , srv1528800373:85 , srv1550172549:85 , srv1554314253:85 , srv1597187615:85 , srv1620809243:85 , srv162823067:85 , srv1655336676:85 , srv1659993636:85 , srv1662834876:85 , srv1750133365:85 , srv1761891222:85 , srv1765760544:85 , srv1899261082:85 , srv1993262465:85 , srv2095260523:85 , srv2106754992:85 , srv2125958762:85 , srv214257697:85 , srv235681894:85 , srv290791528:85 , srv357167871:85 , srv364428049:85 , srv408511955:85 , srv422947609:85 , srv438157519:85 , srv455908053:85 , srv470941460:85 , srv556325354:85 , srv59389388:85 , srv711485854:85 , srv73197421:85 , srv771349743:85 , srv91650368:85 , srv1391640077:86 , srv1512748641:86 , srv1632235002:86 , srv64673953:86 , srv909722785:86 , srv930510154:86 , srv1298053238:632 }
2023-07-24 06:53:16,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:16,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:16,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:16,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:16,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:16,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:16,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:16,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:16,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:16,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:16,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:16,201 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:16,202 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-24 06:53:16,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.980738926391999E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-24 06:53:16,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 402 ms to try 5000 different iterations.  Found a solution that moves 31 regions; Going from a computed imbalance of 4.980738926391999E-5 to a new imbalance of 8.476830625449716E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0034444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:16,508 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1352161119:83 , srv1391640077:83 , srv1512748641:83 , srv1632235002:83 , srv1750133365:83 , srv182666314:83 , srv408511955:83 , srv64673953:83 , srv690665929:83 , srv909722785:83 , srv930510154:83 , srv101202904:84 , srv1039729211:84 , srv1043300779:84 , srv1055104381:84 , srv1058656946:84 , srv1061373980:84 , srv108963571:84 , srv1093731162:84 , srv1099524318:84 , srv1135846767:84 , srv1152730652:84 , srv1188540189:84 , srv1208526088:84 , srv1209161108:84 , srv1274775511:84 , srv1280889016:84 , srv1288997427:84 , srv1293079789:84 , srv1315852220:84 , srv1380758936:84 , srv1423465445:84 , srv1434585311:84 , srv145654355:84 , srv1528800373:84 , srv1531832098:84 , srv1533261977:84 , srv1534426438:84 , srv1550172549:84 , srv1554314253:84 , srv1597187615:84 , srv1597664219:84 , srv1620809243:84 , srv162823067:84 , srv1655336676:84 , srv1655388782:84 , srv1659993636:84 , srv1662834876:84 , srv1761891222:84 , srv1765760544:84 , srv1848463941:84 , srv1899261082:84 , srv1917955008:84 , srv1975933103:84 , srv1993262465:84 , srv2044030271:84 , srv2095260523:84 , srv2125958762:84 , srv214257697:84 , srv231575987:84 , srv235681894:84 , srv250132375:84 , srv275354198:84 , srv290791528:84 , srv316765477:84 , srv357167871:84 , srv359850446:84 , srv364428049:84 , srv386198510:84 , srv393622295:84 , srv422947609:84 , srv438157519:84 , srv455908053:84 , srv470941460:84 , srv556325354:84 , srv569618673:84 , srv582232481:84 , srv59389388:84 , srv711485854:84 , srv73197421:84 , srv738869237:84 , srv771349743:84 , srv876326874:84 , srv895748243:84 , srv915310890:84 , srv91650368:84 , srv946615783:84 , srv950690737:84 , srv1004141674:85 , srv1274770238:85 , srv1333024274:85 , srv1376424101:85 , srv1540498770:85 , srv1865849452:85 , srv1965603091:85 , srv1965686121:85 , srv2106754992:85 , srv635241073:85 , srv726020055:85 , srv1298053238:684 }
2023-07-24 06:53:16,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv290791528=68, srv711485854=87, srv1761891222=48, srv91650368=96, srv1528800373=31, srv2044030271=59, srv1380758936=25, srv59389388=83, srv738869237=90, srv582232481=82, srv1315852220=21, srv1058656946=5, srv1333024274=22, srv1208526088=13, srv556325354=80, srv909722785=94, srv316765477=69, srv1899261082=53, srv1376424101=24, srv438157519=77, srv1280889016=17, srv1043300779=3, srv1662834876=46, srv1620809243=40, srv1423465445=27, srv2106754992=61, srv1655388782=44, srv930510154=97, srv359850446=71, srv386198510=73, srv145654355=29, srv2125958762=62, srv455908053=78, srv1975933103=57, srv250132375=66, srv231575987=64, srv2095260523=60, srv1659993636=45, srv569618673=81, srv1512748641=30, srv1004141674=0, srv1391640077=26, srv1531832098=32, srv1965603091=55, srv1352161119=23, srv1554314253=37, srv726020055=88, srv64673953=85, srv1917955008=54, srv895748243=93, srv946615783=98, srv1750133365=47, srv1848463941=51, srv1540498770=35, srv1039729211=2, srv1099524318=9, srv915310890=95, srv950690737=99, srv1209161108=14, srv1055104381=4, srv1093731162=8, srv1993262465=58, srv364428049=72, srv1533261977=33, srv422947609=76, srv1597664219=39, srv1188540189=12, srv1288997427=18, srv1765760544=49, srv357167871=70, srv408511955=75, srv1293079789=19, srv73197421=89, srv635241073=84, srv1550172549=36, srv275354198=67, srv470941460=79, srv1865849452=52, srv1434585311=28, srv1534426438=34, srv393622295=74, srv101202904=1, srv690665929=86, srv1274770238=15, srv162823067=41, srv771349743=91, srv1135846767=10, srv1597187615=38, srv1152730652=11, srv1655336676=43, srv1061373980=6, srv214257697=63, srv1965686121=56, srv1632235002=42, srv235681894=65, srv876326874=92, srv1274775511=16, srv108963571=7, srv1298053238=20, srv182666314=50} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:16,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:16,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:16,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-24 06:53:16,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-24 06:53:16,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-24 06:53:16,553 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-24 06:53:16,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-24 06:53:16,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-24 06:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-24 06:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-24 06:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-24 06:53:16,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-24 06:53:16,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-24 06:53:16,721 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.259763985991403E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:16,721 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1352161119:83 , srv1391640077:83 , srv1512748641:83 , srv1632235002:83 , srv1750133365:83 , srv182666314:83 , srv408511955:83 , srv64673953:83 , srv690665929:83 , srv909722785:83 , srv930510154:83 , srv101202904:84 , srv1039729211:84 , srv1043300779:84 , srv1055104381:84 , srv1058656946:84 , srv1061373980:84 , srv108963571:84 , srv1093731162:84 , srv1099524318:84 , srv1135846767:84 , srv1152730652:84 , srv1188540189:84 , srv1208526088:84 , srv1209161108:84 , srv1274775511:84 , srv1280889016:84 , srv1288997427:84 , srv1293079789:84 , srv1315852220:84 , srv1380758936:84 , srv1423465445:84 , srv1434585311:84 , srv145654355:84 , srv1528800373:84 , srv1531832098:84 , srv1533261977:84 , srv1534426438:84 , srv1550172549:84 , srv1554314253:84 , srv1597187615:84 , srv1597664219:84 , srv1620809243:84 , srv162823067:84 , srv1655336676:84 , srv1655388782:84 , srv1659993636:84 , srv1662834876:84 , srv1761891222:84 , srv1765760544:84 , srv1848463941:84 , srv1899261082:84 , srv1917955008:84 , srv1975933103:84 , srv1993262465:84 , srv2044030271:84 , srv2095260523:84 , srv2125958762:84 , srv214257697:84 , srv231575987:84 , srv235681894:84 , srv250132375:84 , srv275354198:84 , srv290791528:84 , srv316765477:84 , srv357167871:84 , srv359850446:84 , srv364428049:84 , srv386198510:84 , srv393622295:84 , srv422947609:84 , srv438157519:84 , srv455908053:84 , srv470941460:84 , srv556325354:84 , srv569618673:84 , srv582232481:84 , srv59389388:84 , srv711485854:84 , srv73197421:84 , srv738869237:84 , srv771349743:84 , srv876326874:84 , srv895748243:84 , srv915310890:84 , srv91650368:84 , srv946615783:84 , srv950690737:84 , srv1004141674:85 , srv1274770238:85 , srv1333024274:85 , srv1376424101:85 , srv1540498770:85 , srv1865849452:85 , srv1965603091:85 , srv1965686121:85 , srv2106754992:85 , srv635241073:85 , srv726020055:85 , srv1298053238:684 }
2023-07-24 06:53:16,763 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 313) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 176), AvailableMemoryMB=9503 (was 10379)
2023-07-24 06:53:16,777 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=176, AvailableMemoryMB=9503
2023-07-24 06:53:16,778 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-24 06:53:16,779 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-24 06:53:16,790 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1215349646:84 , srv1274906568:84 , srv138127415:84 , srv1429964549:84 , srv1483734120:84 , srv1562562783:84 , srv1569494386:84 , srv1795333724:84 , srv1824346074:84 , srv182782368:84 , srv188083036:84 , srv1885843539:84 , srv1964808163:84 , srv2053725124:84 , srv2138817826:84 , srv2146828878:84 , srv239621166:84 , srv257216752:84 , srv261358958:84 , srv270873555:84 , srv294963162:84 , srv298828944:84 , srv322583984:84 , srv342998975:84 , srv4596744:84 , srv46478674:84 , srv469208839:84 , srv488544881:84 , srv9444663:84 , srv1589007162:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-24 06:53:16,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:53:16,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1885843539=12, srv342998975=24, srv322583984=23, srv488544881=28, srv1483734120=4, srv257216752=18, srv9444663=29, srv2146828878=16, srv2138817826=15, srv1795333724=8, srv182782368=10, srv270873555=20, srv239621166=17, srv261358958=19, srv138127415=2, srv1562562783=5, srv1215349646=0, srv1429964549=3, srv188083036=11, srv4596744=25, srv46478674=26, srv2053725124=14, srv298828944=22, srv1569494386=6, srv1589007162=7, srv1964808163=13, srv294963162=21, srv1274906568=1, srv1824346074=9, srv469208839=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:53:16,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:53:16,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:53:16,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:53:16,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 06:53:16,839 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1922053762819287, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:53:16,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991279867612886, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1922053762819287, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-24 06:55:16,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5631300 different iterations.  Found a solution that moves 1872 regions; Going from a computed imbalance of 0.991279867612886 to a new imbalance of 4.3693413878060563E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6933333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:55:16,823 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1215349646:90 , srv1274906568:90 , srv138127415:90 , srv1429964549:90 , srv1483734120:90 , srv1562562783:90 , srv1569494386:90 , srv1589007162:90 , srv1795333724:90 , srv1824346074:90 , srv182782368:90 , srv188083036:90 , srv1885843539:90 , srv1964808163:90 , srv2053725124:90 , srv2138817826:90 , srv2146828878:90 , srv239621166:90 , srv257216752:90 , srv261358958:90 , srv270873555:90 , srv294963162:90 , srv298828944:90 , srv322583984:90 , srv342998975:90 , srv4596744:90 , srv46478674:90 , srv469208839:90 , srv488544881:90 , srv9444663:90 }
2023-07-24 06:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-24 06:55:16,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1885843539=12, srv342998975=24, srv322583984=23, srv488544881=28, srv1483734120=4, srv257216752=18, srv9444663=29, srv2146828878=16, srv2138817826=15, srv1795333724=8, srv182782368=10, srv270873555=20, srv239621166=17, srv261358958=19, srv138127415=2, srv1562562783=5, srv1215349646=0, srv1429964549=3, srv188083036=11, srv4596744=25, srv46478674=26, srv2053725124=14, srv298828944=22, srv1569494386=6, srv1589007162=7, srv1964808163=13, srv294963162=21, srv1274906568=1, srv1824346074=9, srv469208839=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-24 06:55:16,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-24 06:55:16,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-24 06:55:16,846 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-24 06:55:16,846 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1215349646:90 , srv1274906568:90 , srv138127415:90 , srv1429964549:90 , srv1483734120:90 , srv1562562783:90 , srv1569494386:90 , srv1589007162:90 , srv1795333724:90 , srv1824346074:90 , srv182782368:90 , srv188083036:90 , srv1885843539:90 , srv1964808163:90 , srv2053725124:90 , srv2138817826:90 , srv2146828878:90 , srv239621166:90 , srv257216752:90 , srv261358958:90 , srv270873555:90 , srv294963162:90 , srv298828944:90 , srv322583984:90 , srv342998975:90 , srv4596744:90 , srv46478674:90 , srv469208839:90 , srv488544881:90 , srv9444663:90 }
2023-07-24 06:55:16,862 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 368), ProcessCount=171 (was 176), AvailableMemoryMB=9399 (was 9503)