2024-04-11 17:53:14,992 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-11 17:53:15,314 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-11 17:53:15,427 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-11 17:53:15,495 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-11 17:53:15,503 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-11 17:53:15,518 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=169, AvailableMemoryMB=9226
2024-04-11 17:53:15,520 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-11 17:53:15,521 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-11 17:53:15,645 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1080407368:84 , srv1088310401:84 , srv1098174494:84 , srv1113754935:84 , srv1132482055:84 , srv1151343369:84 , srv1189000668:84 , srv1212001088:84 , srv1213820152:84 , srv1280348062:84 , srv1306335768:84 , srv1318628301:84 , srv1376723779:84 , srv1380481875:84 , srv1393496768:84 , srv1403678527:84 , srv1408524100:84 , srv141056935:84 , srv1414601921:84 , srv1444822250:84 , srv1453897757:84 , srv1479824066:84 , srv1482953377:84 , srv1562040738:84 , srv1562886011:84 , srv1568047021:84 , srv1633011511:84 , srv1671849686:84 , srv1698741234:84 , srv1716029357:84 , srv1716123262:84 , srv1744492616:84 , srv1749848347:84 , srv1795168380:84 , srv1814175903:84 , srv182027475:84 , srv1834280755:84 , srv1839107159:84 , srv1881115880:84 , srv1883003341:84 , srv1921815493:84 , srv1923798101:84 , srv1949161530:84 , srv1963402118:84 , srv1974031925:84 , srv2013085353:84 , srv2036511162:84 , srv2048618645:84 , srv2055554036:84 , srv2063652041:84 , srv20691718:84 , srv2076452736:84 , srv2088901418:84 , srv2100197727:84 , srv2109745268:84 , srv2127309419:84 , srv2128293787:84 , srv2139574490:84 , srv22296027:84 , srv228084045:84 , srv236590778:84 , srv252149026:84 , srv271905558:84 , srv296927568:84 , srv302589154:84 , srv332539867:84 , srv387891680:84 , srv407344902:84 , srv408735417:84 , srv411942821:84 , srv430717332:84 , srv437493706:84 , srv447595257:84 , srv473919118:84 , srv482082774:84 , srv486451412:84 , srv505926498:84 , srv572074781:84 , srv57669045:84 , srv582749282:84 , srv591863359:84 , srv593202811:84 , srv614630334:84 , srv694258682:84 , srv708786641:84 , srv710749565:84 , srv759413589:84 , srv764362586:84 , srv767031293:84 , srv770573628:84 , srv808317335:84 , srv818250320:84 , srv849971785:84 , srv855244042:84 , srv862886592:84 , srv889235923:84 , srv892334160:84 , srv894112595:84 , srv918699239:84 , srv1918063453:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-11 17:53:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:15,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:15,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:15,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:15,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:15,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:15,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:15,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:15,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:15,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:15,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:15,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:15,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:15,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:15,973 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-11 17:53:15,973 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-11 17:53:16,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 645 ms to try 5000 different iterations.  Found a solution that moves 4658 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1829768915218072. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04196685727291546, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0552313774090874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5175555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04196685727291546, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:16,450 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv302589154:81 , srv1408524100:82 , srv1716123262:82 , srv271905558:82 , srv1113754935:83 , srv1716029357:83 , srv2048618645:83 , srv2055554036:83 , srv20691718:83 , srv2127309419:83 , srv1088310401:84 , srv1380481875:84 , srv1795168380:84 , srv1814175903:84 , srv1839107159:84 , srv1923798101:84 , srv2036511162:84 , srv2128293787:84 , srv252149026:84 , srv447595257:84 , srv505926498:84 , srv694258682:84 , srv764362586:84 , srv818250320:84 , srv889235923:84 , srv1080407368:85 , srv1098174494:85 , srv1151343369:85 , srv1318628301:85 , srv1414601921:85 , srv1453897757:85 , srv1479824066:85 , srv1482953377:85 , srv1562886011:85 , srv1568047021:85 , srv1881115880:85 , srv1963402118:85 , srv2100197727:85 , srv2109745268:85 , srv228084045:85 , srv236590778:85 , srv407344902:85 , srv408735417:85 , srv486451412:85 , srv57669045:85 , srv918699239:85 , srv1280348062:86 , srv141056935:86 , srv1671849686:86 , srv1749848347:86 , srv182027475:86 , srv2013085353:86 , srv2139574490:86 , srv387891680:86 , srv430717332:86 , srv572074781:86 , srv593202811:86 , srv767031293:86 , srv808317335:86 , srv855244042:86 , srv1132482055:87 , srv1306335768:87 , srv1403678527:87 , srv1444822250:87 , srv1834280755:87 , srv1883003341:87 , srv2063652041:87 , srv2076452736:87 , srv411942821:87 , srv473919118:87 , srv482082774:87 , srv582749282:87 , srv591863359:87 , srv708786641:87 , srv849971785:87 , srv862886592:87 , srv892334160:87 , srv1562040738:88 , srv1633011511:88 , srv1744492616:88 , srv1921815493:88 , srv2088901418:88 , srv1189000668:89 , srv1949161530:89 , srv1974031925:89 , srv22296027:89 , srv332539867:89 , srv759413589:89 , srv437493706:90 , srv710749565:90 , srv894112595:90 , srv1213820152:91 , srv296927568:91 , srv614630334:91 , srv1698741234:92 , srv770573628:92 , srv1376723779:94 , srv1393496768:94 , srv1212001088:95 , srv1918063453:463 }
2024-04-11 17:53:16,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:16,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:16,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:16,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:16,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:16,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:16,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:16,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:16,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:16,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:16,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:16,713 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04196685727291546, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0552313774090874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04196685727291546, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:16,713 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-11 17:53:16,714 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18294427550869116, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04196685727291546, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0552313774090874, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04196685727291546, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17816666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24541666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-11 17:53:17,072 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 532 ms to try 5000 different iterations.  Found a solution that moves 2718 regions; Going from a computed imbalance of 0.18294427550869116 to a new imbalance of 0.014193581821205689. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021702106329330506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030711722135745006, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.302, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021702106329330506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:17,083 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1212001088:77 , srv1376723779:77 , srv1393496768:79 , srv1698741234:79 , srv296927568:80 , srv1213820152:81 , srv1949161530:81 , srv22296027:81 , srv437493706:81 , srv1562040738:82 , srv614630334:82 , srv759413589:82 , srv770573628:82 , srv1633011511:83 , srv1974031925:83 , srv332539867:83 , srv894112595:83 , srv1132482055:84 , srv1883003341:84 , srv2076452736:84 , srv2088901418:84 , srv582749282:84 , srv710749565:84 , srv808317335:84 , srv1189000668:85 , srv1306335768:85 , srv1562886011:85 , srv1568047021:85 , srv1671849686:85 , srv1744492616:85 , srv182027475:85 , srv1834280755:85 , srv2013085353:85 , srv387891680:85 , srv411942821:85 , srv430717332:85 , srv473919118:85 , srv482082774:85 , srv591863359:85 , srv708786641:85 , srv892334160:85 , srv918699239:85 , srv1280348062:86 , srv1403678527:86 , srv141056935:86 , srv1444822250:86 , srv1479824066:86 , srv1482953377:86 , srv1749848347:86 , srv1881115880:86 , srv1921815493:86 , srv1923798101:86 , srv2063652041:86 , srv2139574490:86 , srv849971785:86 , srv862886592:86 , srv889235923:86 , srv1088310401:87 , srv1098174494:87 , srv1151343369:87 , srv1318628301:87 , srv1414601921:87 , srv1453897757:87 , srv1963402118:87 , srv2036511162:87 , srv236590778:87 , srv407344902:87 , srv408735417:87 , srv57669045:87 , srv694258682:87 , srv764362586:87 , srv855244042:87 , srv1380481875:88 , srv1716029357:88 , srv2109745268:88 , srv2127309419:88 , srv228084045:88 , srv252149026:88 , srv572074781:88 , srv593202811:88 , srv767031293:88 , srv1080407368:89 , srv1113754935:89 , srv1839107159:89 , srv2048618645:89 , srv2055554036:89 , srv20691718:89 , srv2128293787:89 , srv505926498:89 , srv1408524100:90 , srv1716123262:90 , srv1795168380:90 , srv1814175903:90 , srv2100197727:90 , srv447595257:90 , srv486451412:90 , srv818250320:90 , srv271905558:91 , srv302589154:92 , srv1918063453:504 }
2024-04-11 17:53:17,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:17,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:17,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:17,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:17,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:17,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:17,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:17,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:17,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:17,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:17,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:17,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:17,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:17,125 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:17,126 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:17,127 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:17,246 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021702106329330506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030711722135745006, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021702106329330506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:17,246 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-11 17:53:17,246 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014174549978429958, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021702106329330506); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030711722135745006, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021702106329330506); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01075); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04725, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-11 17:53:17,589 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 446 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.014174549978429958 to a new imbalance of 0.0011777732294429957. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0034274043584014893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0034274043584014893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:17,592 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2100197727:82 , srv486451412:82 , srv1189000668:83 , srv447595257:83 , srv572074781:83 , srv593202811:83 , srv818250320:83 , srv1080407368:84 , srv1403678527:84 , srv1814175903:84 , srv1921815493:84 , srv2063652041:84 , srv767031293:84 , srv770573628:84 , srv849971785:84 , srv855244042:84 , srv1151343369:85 , srv1306335768:85 , srv1318628301:85 , srv1380481875:85 , srv1393496768:85 , srv1408524100:85 , srv141056935:85 , srv1414601921:85 , srv1444822250:85 , srv1716123262:85 , srv1744492616:85 , srv1795168380:85 , srv1839107159:85 , srv2088901418:85 , srv2109745268:85 , srv228084045:85 , srv252149026:85 , srv271905558:85 , srv302589154:85 , srv332539867:85 , srv505926498:85 , srv614630334:85 , srv710749565:85 , srv862886592:85 , srv894112595:85 , srv1088310401:86 , srv1098174494:86 , srv1113754935:86 , srv1212001088:86 , srv1213820152:86 , srv1280348062:86 , srv1453897757:86 , srv1479824066:86 , srv1482953377:86 , srv1633011511:86 , srv1716029357:86 , srv1749848347:86 , srv1881115880:86 , srv1963402118:86 , srv1974031925:86 , srv2048618645:86 , srv2055554036:86 , srv20691718:86 , srv2076452736:86 , srv2127309419:86 , srv2128293787:86 , srv2139574490:86 , srv236590778:86 , srv407344902:86 , srv408735417:86 , srv411942821:86 , srv473919118:86 , srv482082774:86 , srv57669045:86 , srv591863359:86 , srv764362586:86 , srv892334160:86 , srv1132482055:87 , srv1376723779:87 , srv1562040738:87 , srv1562886011:87 , srv1671849686:87 , srv1698741234:87 , srv182027475:87 , srv1834280755:87 , srv1883003341:87 , srv2013085353:87 , srv2036511162:87 , srv22296027:87 , srv296927568:87 , srv387891680:87 , srv430717332:87 , srv437493706:87 , srv582749282:87 , srv708786641:87 , srv759413589:87 , srv808317335:87 , srv889235923:87 , srv1568047021:88 , srv1923798101:88 , srv1949161530:88 , srv694258682:88 , srv918699239:88 , srv1918063453:521 }
2024-04-11 17:53:17,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:17,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:17,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:17,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:17,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:17,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:17,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:17,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:17,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:17,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:17,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:17,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:17,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:17,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:17,781 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0034274043584014893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0034274043584014893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:17,782 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-11 17:53:17,782 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011709391313748888, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0034274043584014893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006461489127967465); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0034274043584014893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=6.666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-11 17:53:18,256 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 611 ms to try 5000 different iterations.  Found a solution that moves 274 regions; Going from a computed imbalance of 0.0011709391313748888 to a new imbalance of 3.536153082030515E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.030444444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:18,257 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv694258682:82 , srv1080407368:83 , srv1749848347:83 , srv1795168380:83 , srv1834280755:83 , srv2048618645:83 , srv2128293787:83 , srv296927568:83 , srv473919118:83 , srv708786641:83 , srv1098174494:84 , srv1113754935:84 , srv1132482055:84 , srv1212001088:84 , srv1213820152:84 , srv1280348062:84 , srv1376723779:84 , srv1393496768:84 , srv1444822250:84 , srv1453897757:84 , srv1568047021:84 , srv1698741234:84 , srv1814175903:84 , srv182027475:84 , srv1839107159:84 , srv1883003341:84 , srv1921815493:84 , srv1923798101:84 , srv1949161530:84 , srv1963402118:84 , srv1974031925:84 , srv2036511162:84 , srv2055554036:84 , srv20691718:84 , srv2109745268:84 , srv2127309419:84 , srv2139574490:84 , srv228084045:84 , srv236590778:84 , srv302589154:84 , srv387891680:84 , srv407344902:84 , srv408735417:84 , srv411942821:84 , srv430717332:84 , srv437493706:84 , srv482082774:84 , srv505926498:84 , srv582749282:84 , srv710749565:84 , srv759413589:84 , srv764362586:84 , srv767031293:84 , srv770573628:84 , srv818250320:84 , srv862886592:84 , srv889235923:84 , srv892334160:84 , srv918699239:84 , srv1088310401:85 , srv1151343369:85 , srv1189000668:85 , srv1306335768:85 , srv1318628301:85 , srv1380481875:85 , srv1403678527:85 , srv1408524100:85 , srv141056935:85 , srv1414601921:85 , srv1479824066:85 , srv1482953377:85 , srv1562040738:85 , srv1562886011:85 , srv1633011511:85 , srv1671849686:85 , srv1716029357:85 , srv1716123262:85 , srv1744492616:85 , srv1881115880:85 , srv2013085353:85 , srv2063652041:85 , srv2076452736:85 , srv2088901418:85 , srv22296027:85 , srv252149026:85 , srv271905558:85 , srv332539867:85 , srv447595257:85 , srv486451412:85 , srv572074781:85 , srv57669045:85 , srv591863359:85 , srv593202811:85 , srv614630334:85 , srv808317335:85 , srv849971785:85 , srv855244042:85 , srv894112595:85 , srv2100197727:86 , srv1918063453:654 }
2024-04-11 17:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:18,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:18,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:18,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:18,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:18,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:18,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:18,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:18,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:18,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:18,387 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:18,387 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-11 17:53:18,387 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.344294181348005E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-11 17:53:18,613 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 321 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 3.344294181348005E-5 to a new imbalance of 6.256147528846628E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:18,614 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1671849686:83 , srv1744492616:83 , srv2013085353:83 , srv2100197727:83 , srv271905558:83 , srv57669045:83 , srv591863359:83 , srv614630334:83 , srv710749565:83 , srv894112595:83 , srv1088310401:84 , srv1098174494:84 , srv1113754935:84 , srv1132482055:84 , srv1151343369:84 , srv1189000668:84 , srv1212001088:84 , srv1213820152:84 , srv1280348062:84 , srv1306335768:84 , srv1318628301:84 , srv1376723779:84 , srv1380481875:84 , srv1393496768:84 , srv1403678527:84 , srv1408524100:84 , srv141056935:84 , srv1414601921:84 , srv1444822250:84 , srv1453897757:84 , srv1479824066:84 , srv1482953377:84 , srv1562040738:84 , srv1562886011:84 , srv1568047021:84 , srv1633011511:84 , srv1698741234:84 , srv1716029357:84 , srv1716123262:84 , srv1795168380:84 , srv1814175903:84 , srv182027475:84 , srv1834280755:84 , srv1839107159:84 , srv1881115880:84 , srv1883003341:84 , srv1921815493:84 , srv1923798101:84 , srv1949161530:84 , srv1963402118:84 , srv1974031925:84 , srv2036511162:84 , srv2055554036:84 , srv2063652041:84 , srv20691718:84 , srv2076452736:84 , srv2088901418:84 , srv2109745268:84 , srv2128293787:84 , srv2139574490:84 , srv22296027:84 , srv228084045:84 , srv236590778:84 , srv252149026:84 , srv302589154:84 , srv332539867:84 , srv387891680:84 , srv407344902:84 , srv408735417:84 , srv411942821:84 , srv430717332:84 , srv437493706:84 , srv447595257:84 , srv482082774:84 , srv486451412:84 , srv505926498:84 , srv572074781:84 , srv582749282:84 , srv593202811:84 , srv708786641:84 , srv759413589:84 , srv767031293:84 , srv770573628:84 , srv808317335:84 , srv849971785:84 , srv855244042:84 , srv862886592:84 , srv892334160:84 , srv918699239:84 , srv1080407368:85 , srv1749848347:85 , srv2048618645:85 , srv2127309419:85 , srv296927568:85 , srv473919118:85 , srv694258682:85 , srv764362586:85 , srv818250320:85 , srv889235923:85 , srv1918063453:684 }
2024-04-11 17:53:18,617 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:18,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv22296027=59, srv1839107159=37, srv1088310401=1, srv1814175903=34, srv818250320=92, srv1949161530=43, srv411942821=70, srv1918063453=40, srv2139574490=58, srv708786641=85, srv694258682=84, srv1132482055=4, srv407344902=68, srv918699239=99, srv271905558=63, srv1113754935=3, srv2109745268=55, srv2036511162=47, srv808317335=91, srv1562040738=23, srv1376723779=12, srv1568047021=25, srv252149026=62, srv614630334=83, srv482082774=75, srv1393496768=14, srv759413589=87, srv889235923=96, srv2076452736=52, srv1080407368=0, srv20691718=51, srv447595257=73, srv591863359=81, srv2013085353=46, srv1414601921=18, srv764362586=88, srv2127309419=56, srv892334160=97, srv1189000668=6, srv1671849686=27, srv862886592=95, srv437493706=72, srv593202811=82, srv767031293=89, srv1098174494=2, srv1749848347=32, srv1380481875=13, srv582749282=80, srv849971785=93, srv1213820152=8, srv710749565=86, srv894112595=98, srv182027475=35, srv302589154=65, srv1408524100=16, srv770573628=90, srv1444822250=19, srv1479824066=21, srv141056935=17, srv1716029357=29, srv387891680=67, srv1212001088=7, srv296927568=64, srv1562886011=24, srv2048618645=48, srv1834280755=36, srv228084045=60, srv1318628301=11, srv1881115880=38, srv332539867=66, srv2088901418=53, srv408735417=69, srv1151343369=5, srv1921815493=41, srv1633011511=26, srv1974031925=45, srv2100197727=54, srv1403678527=15, srv486451412=76, srv1744492616=31, srv1883003341=39, srv1280348062=9, srv430717332=71, srv2128293787=57, srv2055554036=49, srv1923798101=42, srv1453897757=20, srv473919118=74, srv1482953377=22, srv1306335768=10, srv1795168380=33, srv505926498=77, srv1698741234=28, srv572074781=78, srv2063652041=50, srv236590778=61, srv1716123262=30, srv855244042=94, srv57669045=79, srv1963402118=44} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:18,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-11 17:53:18,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-11 17:53:18,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-11 17:53:18,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-11 17:53:18,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-11 17:53:18,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-11 17:53:18,743 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:18,744 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1671849686:83 , srv1744492616:83 , srv2013085353:83 , srv2100197727:83 , srv271905558:83 , srv57669045:83 , srv591863359:83 , srv614630334:83 , srv710749565:83 , srv894112595:83 , srv1088310401:84 , srv1098174494:84 , srv1113754935:84 , srv1132482055:84 , srv1151343369:84 , srv1189000668:84 , srv1212001088:84 , srv1213820152:84 , srv1280348062:84 , srv1306335768:84 , srv1318628301:84 , srv1376723779:84 , srv1380481875:84 , srv1393496768:84 , srv1403678527:84 , srv1408524100:84 , srv141056935:84 , srv1414601921:84 , srv1444822250:84 , srv1453897757:84 , srv1479824066:84 , srv1482953377:84 , srv1562040738:84 , srv1562886011:84 , srv1568047021:84 , srv1633011511:84 , srv1698741234:84 , srv1716029357:84 , srv1716123262:84 , srv1795168380:84 , srv1814175903:84 , srv182027475:84 , srv1834280755:84 , srv1839107159:84 , srv1881115880:84 , srv1883003341:84 , srv1921815493:84 , srv1923798101:84 , srv1949161530:84 , srv1963402118:84 , srv1974031925:84 , srv2036511162:84 , srv2055554036:84 , srv2063652041:84 , srv20691718:84 , srv2076452736:84 , srv2088901418:84 , srv2109745268:84 , srv2128293787:84 , srv2139574490:84 , srv22296027:84 , srv228084045:84 , srv236590778:84 , srv252149026:84 , srv302589154:84 , srv332539867:84 , srv387891680:84 , srv407344902:84 , srv408735417:84 , srv411942821:84 , srv430717332:84 , srv437493706:84 , srv447595257:84 , srv482082774:84 , srv486451412:84 , srv505926498:84 , srv572074781:84 , srv582749282:84 , srv593202811:84 , srv708786641:84 , srv759413589:84 , srv767031293:84 , srv770573628:84 , srv808317335:84 , srv849971785:84 , srv855244042:84 , srv862886592:84 , srv892334160:84 , srv918699239:84 , srv1080407368:85 , srv1749848347:85 , srv2048618645:85 , srv2127309419:85 , srv296927568:85 , srv473919118:85 , srv694258682:85 , srv764362586:85 , srv818250320:85 , srv889235923:85 , srv1918063453:684 }
2024-04-11 17:53:18,768 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=346 (was 315) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=8481 (was 9226)
2024-04-11 17:53:18,776 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=169, AvailableMemoryMB=8480
2024-04-11 17:53:18,777 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-11 17:53:18,777 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-11 17:53:18,787 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1061097909:84 , srv1087358076:84 , srv109541050:84 , srv1162247583:84 , srv1167052734:84 , srv129379861:84 , srv1520177335:84 , srv160353399:84 , srv1679361096:84 , srv1760435983:84 , srv1783923570:84 , srv1834278106:84 , srv1851923861:84 , srv1896254244:84 , srv1930977578:84 , srv1948330987:84 , srv204946293:84 , srv2121834396:84 , srv220366525:84 , srv280245165:84 , srv284560419:84 , srv419057151:84 , srv462401146:84 , srv542623594:84 , srv59775812:84 , srv627060683:84 , srv649847626:84 , srv805611782:84 , srv980372001:84 , srv1392411582:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-11 17:53:18,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:53:18,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1930977578=15, srv1520177335=7, srv204946293=17, srv1087358076=1, srv109541050=2, srv1851923861=13, srv284560419=21, srv1679361096=9, srv1760435983=10, srv805611782=28, srv542623594=24, srv1783923570=11, srv1896254244=14, srv2121834396=18, srv129379861=5, srv280245165=20, srv220366525=19, srv462401146=23, srv1162247583=3, srv1167052734=4, srv59775812=25, srv419057151=22, srv627060683=26, srv980372001=29, srv649847626=27, srv1948330987=16, srv160353399=8, srv1061097909=0, srv1392411582=6, srv1834278106=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-11 17:53:18,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0985928495700286, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:53:18,813 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912503706113922, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0985928495700286, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-11 17:55:18,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5631037 different iterations.  Found a solution that moves 1868 regions; Going from a computed imbalance of 0.9912503706113922 to a new imbalance of 4.360005188259462E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6918518518518518, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:55:18,808 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1061097909:90 , srv1087358076:90 , srv109541050:90 , srv1162247583:90 , srv1167052734:90 , srv129379861:90 , srv1392411582:90 , srv1520177335:90 , srv160353399:90 , srv1679361096:90 , srv1760435983:90 , srv1783923570:90 , srv1834278106:90 , srv1851923861:90 , srv1896254244:90 , srv1930977578:90 , srv1948330987:90 , srv204946293:90 , srv2121834396:90 , srv220366525:90 , srv280245165:90 , srv284560419:90 , srv419057151:90 , srv462401146:90 , srv542623594:90 , srv59775812:90 , srv627060683:90 , srv649847626:90 , srv805611782:90 , srv980372001:90 }
2024-04-11 17:55:18,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-11 17:55:18,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1930977578=15, srv1520177335=7, srv204946293=17, srv1087358076=1, srv109541050=2, srv1851923861=13, srv284560419=21, srv1679361096=9, srv1760435983=10, srv805611782=28, srv542623594=24, srv1783923570=11, srv1896254244=14, srv2121834396=18, srv129379861=5, srv280245165=20, srv220366525=19, srv462401146=23, srv1162247583=3, srv1167052734=4, srv59775812=25, srv419057151=22, srv627060683=26, srv980372001=29, srv649847626=27, srv1948330987=16, srv160353399=8, srv1061097909=0, srv1392411582=6, srv1834278106=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-11 17:55:18,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-11 17:55:18,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-11 17:55:18,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-11 17:55:18,833 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-11 17:55:18,833 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1061097909:90 , srv1087358076:90 , srv109541050:90 , srv1162247583:90 , srv1167052734:90 , srv129379861:90 , srv1392411582:90 , srv1520177335:90 , srv160353399:90 , srv1679361096:90 , srv1760435983:90 , srv1783923570:90 , srv1834278106:90 , srv1851923861:90 , srv1896254244:90 , srv1930977578:90 , srv1948330987:90 , srv204946293:90 , srv2121834396:90 , srv220366525:90 , srv280245165:90 , srv284560419:90 , srv419057151:90 , srv462401146:90 , srv542623594:90 , srv59775812:90 , srv627060683:90 , srv649847626:90 , srv805611782:90 , srv980372001:90 }
2024-04-11 17:55:18,850 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 346), ProcessCount=167 (was 169), AvailableMemoryMB=7711 (was 8480)