2023-09-16 19:53:12,681 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-09-16 19:53:13,011 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-09-16 19:53:13,121 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-09-16 19:53:13,188 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-16 19:53:13,195 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-16 19:53:13,208 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=248, ProcessCount=174, AvailableMemoryMB=8922
2023-09-16 19:53:13,210 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-16 19:53:13,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-09-16 19:53:13,362 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1048870564:84 , srv106652934:84 , srv1089078264:84 , srv1099016538:84 , srv1119861729:84 , srv1129850842:84 , srv1131051900:84 , srv1139502034:84 , srv1144311892:84 , srv1154158647:84 , srv1195058799:84 , srv1209475880:84 , srv1221695635:84 , srv1244224326:84 , srv1287574984:84 , srv1302091973:84 , srv1349462548:84 , srv1356517300:84 , srv135705622:84 , srv1390824636:84 , srv139181850:84 , srv140482086:84 , srv1407144496:84 , srv1423794559:84 , srv1436155267:84 , srv1448576165:84 , srv1488333781:84 , srv1489512082:84 , srv1490125830:84 , srv1523902921:84 , srv1554220574:84 , srv1569600865:84 , srv1573513349:84 , srv1594205075:84 , srv1598891322:84 , srv1599686034:84 , srv1622791493:84 , srv1671492561:84 , srv1693215299:84 , srv1696825090:84 , srv1735387777:84 , srv1748107998:84 , srv1751299595:84 , srv1813753655:84 , srv1819791401:84 , srv1900763732:84 , srv1919487000:84 , srv1921461517:84 , srv1928836806:84 , srv1941112518:84 , srv1969126213:84 , srv1971042980:84 , srv1972130003:84 , srv1997998206:84 , srv2014573622:84 , srv2056606793:84 , srv2075849982:84 , srv2080267185:84 , srv214655672:84 , srv2147410930:84 , srv272247539:84 , srv274516585:84 , srv279822253:84 , srv313046269:84 , srv3187337:84 , srv324434899:84 , srv348223129:84 , srv35995889:84 , srv386542591:84 , srv400742139:84 , srv414080867:84 , srv440697117:84 , srv468114299:84 , srv482090796:84 , srv484949487:84 , srv495199735:84 , srv51440515:84 , srv516935111:84 , srv537134665:84 , srv57258996:84 , srv593253291:84 , srv652667794:84 , srv66944130:84 , srv673326451:84 , srv675481961:84 , srv691381154:84 , srv712936774:84 , srv729697031:84 , srv730989086:84 , srv74650351:84 , srv787038777:84 , srv848978047:84 , srv85500755:84 , srv858548843:84 , srv879752551:84 , srv935738097:84 , srv944328585:84 , srv961262408:84 , srv991502259:84 , srv1460966538:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-09-16 19:53:13,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:13,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv324434899=66, srv1735387777=41, srv961262408=98, srv1941112518=50, srv675481961=85, srv2056606793=56, srv652667794=82, srv386542591=69, srv1302091973=15, srv1490125830=29, srv1195058799=10, srv1819791401=45, srv1622791493=37, srv1813753655=44, srv730989086=89, srv2014573622=55, srv85500755=93, srv944328585=97, srv991502259=99, srv516935111=78, srv139181850=20, srv468114299=73, srv1448576165=25, srv1129850842=5, srv1099016538=3, srv787038777=91, srv135705622=18, srv482090796=74, srv1390824636=19, srv1523902921=30, srv106652934=1, srv1919487000=47, srv2147410930=60, srv1154158647=9, srv1997998206=54, srv1696825090=40, srv1209475880=11, srv1569600865=32, srv1221695635=12, srv1244224326=13, srv348223129=67, srv2080267185=58, srv1144311892=8, srv495199735=76, srv74650351=90, srv1349462548=16, srv1598891322=35, srv879752551=95, srv1900763732=46, srv1089078264=2, srv1131051900=6, srv1969126213=51, srv414080867=71, srv712936774=87, srv1599686034=36, srv691381154=86, srv1928836806=49, srv1972130003=53, srv214655672=59, srv1748107998=42, srv1751299595=43, srv1139502034=7, srv51440515=77, srv484949487=75, srv66944130=83, srv1573513349=33, srv1921461517=48, srv1671492561=38, srv729697031=88, srv313046269=64, srv673326451=84, srv1554220574=31, srv279822253=63, srv140482086=21, srv1594205075=34, srv1971042980=52, srv272247539=61, srv400742139=70, srv848978047=92, srv2075849982=57, srv1356517300=17, srv1693215299=39, srv1460966538=26, srv593253291=81, srv1048870564=0, srv57258996=80, srv1436155267=24, srv35995889=68, srv537134665=79, srv1423794559=23, srv1119861729=4, srv440697117=72, srv1287574984=14, srv274516585=62, srv3187337=65, srv935738097=96, srv1488333781=27, srv858548843=94, srv1407144496=22, srv1489512082=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:13,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:13,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:13,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:13,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:13,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:13,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:13,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:13,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:13,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:13,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:13,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:13,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:13,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:13,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:13,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:13,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-16 19:53:13,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-16 19:53:13,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-16 19:53:13,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-16 19:53:13,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-16 19:53:13,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-16 19:53:13,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-16 19:53:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-16 19:53:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-16 19:53:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-16 19:53:13,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-16 19:53:13,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-16 19:53:13,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-16 19:53:13,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-16 19:53:13,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-16 19:53:13,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-16 19:53:13,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-16 19:53:13,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:13,736 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-16 19:53:13,736 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-16 19:53:14,053 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 547 ms to try 5000 different iterations.  Found a solution that moves 4667 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18292026114604984. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04098579498980716, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04868644955601476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5185555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04098579498980716, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:14,067 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1244224326:80 , srv2056606793:81 , srv279822253:81 , srv51440515:81 , srv730989086:81 , srv1129850842:82 , srv1209475880:82 , srv400742139:82 , srv1089078264:83 , srv1423794559:83 , srv1813753655:83 , srv1972130003:83 , srv516935111:83 , srv729697031:83 , srv1921461517:84 , srv2014573622:84 , srv348223129:84 , srv386542591:84 , srv468114299:84 , srv482090796:84 , srv593253291:84 , srv675481961:84 , srv691381154:84 , srv848978047:84 , srv85500755:84 , srv1099016538:85 , srv1154158647:85 , srv1221695635:85 , srv1489512082:85 , srv1523902921:85 , srv1569600865:85 , srv1693215299:85 , srv1696825090:85 , srv1941112518:85 , srv1997998206:85 , srv2075849982:85 , srv2147410930:85 , srv272247539:85 , srv537134665:85 , srv652667794:85 , srv66944130:85 , srv673326451:85 , srv787038777:85 , srv961262408:85 , srv991502259:85 , srv106652934:86 , srv1139502034:86 , srv140482086:86 , srv1407144496:86 , srv1490125830:86 , srv1671492561:86 , srv214655672:86 , srv414080867:86 , srv935738097:86 , srv1144311892:87 , srv1195058799:87 , srv135705622:87 , srv139181850:87 , srv1554220574:87 , srv1598891322:87 , srv1599686034:87 , srv1735387777:87 , srv1751299595:87 , srv1928836806:87 , srv2080267185:87 , srv35995889:87 , srv484949487:87 , srv712936774:87 , srv74650351:87 , srv1048870564:88 , srv1119861729:88 , srv1488333781:88 , srv1573513349:88 , srv1622791493:88 , srv1748107998:88 , srv1819791401:88 , srv1919487000:88 , srv1969126213:88 , srv274516585:88 , srv879752551:88 , srv1436155267:89 , srv1971042980:89 , srv313046269:89 , srv440697117:89 , srv858548843:89 , srv1287574984:90 , srv1390824636:90 , srv1448576165:90 , srv3187337:90 , srv495199735:90 , srv1349462548:91 , srv1356517300:91 , srv1594205075:91 , srv1302091973:92 , srv1900763732:92 , srv57258996:92 , srv324434899:93 , srv1131051900:94 , srv944328585:96 , srv1460966538:454 }
2023-09-16 19:53:14,073 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:14,074 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv324434899=66, srv1735387777=41, srv961262408=98, srv1941112518=50, srv675481961=85, srv2056606793=56, srv652667794=82, srv386542591=69, srv1302091973=15, srv1490125830=29, srv1195058799=10, srv1819791401=45, srv1622791493=37, srv1813753655=44, srv730989086=89, srv2014573622=55, srv85500755=93, srv944328585=97, srv991502259=99, srv516935111=78, srv139181850=20, srv468114299=73, srv1448576165=25, srv1129850842=5, srv1099016538=3, srv787038777=91, srv135705622=18, srv482090796=74, srv1390824636=19, srv1523902921=30, srv106652934=1, srv1919487000=47, srv2147410930=60, srv1154158647=9, srv1997998206=54, srv1696825090=40, srv1209475880=11, srv1569600865=32, srv1221695635=12, srv1244224326=13, srv348223129=67, srv2080267185=58, srv1144311892=8, srv495199735=76, srv74650351=90, srv1349462548=16, srv1598891322=35, srv879752551=95, srv1900763732=46, srv1089078264=2, srv1131051900=6, srv1969126213=51, srv414080867=71, srv712936774=87, srv1599686034=36, srv691381154=86, srv1928836806=49, srv1972130003=53, srv214655672=59, srv1748107998=42, srv1751299595=43, srv1139502034=7, srv51440515=77, srv484949487=75, srv66944130=83, srv1573513349=33, srv1921461517=48, srv1671492561=38, srv729697031=88, srv313046269=64, srv673326451=84, srv1554220574=31, srv279822253=63, srv140482086=21, srv1594205075=34, srv1971042980=52, srv272247539=61, srv400742139=70, srv848978047=92, srv2075849982=57, srv1356517300=17, srv1693215299=39, srv1460966538=26, srv593253291=81, srv1048870564=0, srv57258996=80, srv1436155267=24, srv35995889=68, srv537134665=79, srv1423794559=23, srv1119861729=4, srv440697117=72, srv1287574984=14, srv274516585=62, srv3187337=65, srv935738097=96, srv1488333781=27, srv858548843=94, srv1407144496=22, srv1489512082=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:14,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:14,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:14,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:14,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-16 19:53:14,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-16 19:53:14,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-16 19:53:14,102 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-16 19:53:14,103 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-16 19:53:14,104 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-16 19:53:14,105 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-16 19:53:14,106 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-16 19:53:14,270 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04098579498980716, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04868644955601476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04098579498980716, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:14,271 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-16 19:53:14,271 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18288758211358688, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04098579498980716, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04868644955601476, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04098579498980716, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17808333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.246, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-16 19:53:14,577 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 451 ms to try 5000 different iterations.  Found a solution that moves 2679 regions; Going from a computed imbalance of 0.18288758211358688 to a new imbalance of 0.01673898269552724. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02461576531883984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03145909285100027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2976666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02461576531883984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:14,592 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1131051900:77 , srv1302091973:78 , srv944328585:78 , srv1594205075:79 , srv1900763732:79 , srv57258996:79 , srv324434899:80 , srv1356517300:81 , srv1287574984:82 , srv1349462548:82 , srv1390824636:82 , srv1448576165:82 , srv313046269:82 , srv495199735:82 , srv879752551:82 , srv1119861729:83 , srv1144311892:83 , srv1490125830:83 , srv1573513349:83 , srv1919487000:83 , srv1928836806:83 , srv214655672:83 , srv712936774:83 , srv1195058799:84 , srv135705622:84 , srv1436155267:84 , srv1554220574:84 , srv1751299595:84 , srv1971042980:84 , srv2080267185:84 , srv274516585:84 , srv3187337:84 , srv440697117:84 , srv74650351:84 , srv858548843:84 , srv1048870564:85 , srv1099016538:85 , srv1139502034:85 , srv1221695635:85 , srv140482086:85 , srv1488333781:85 , srv1489512082:85 , srv1569600865:85 , srv1598891322:85 , srv1622791493:85 , srv1748107998:85 , srv1819791401:85 , srv1969126213:85 , srv272247539:85 , srv106652934:86 , srv139181850:86 , srv1599686034:86 , srv1735387777:86 , srv35995889:86 , srv484949487:86 , srv537134665:86 , srv675481961:86 , srv787038777:86 , srv935738097:86 , srv1154158647:87 , srv1407144496:87 , srv1523902921:87 , srv1671492561:87 , srv1693215299:87 , srv1696825090:87 , srv1921461517:87 , srv2014573622:87 , srv2147410930:87 , srv348223129:87 , srv414080867:87 , srv482090796:87 , srv673326451:87 , srv691381154:87 , srv991502259:87 , srv1423794559:88 , srv1941112518:88 , srv1972130003:88 , srv1997998206:88 , srv2075849982:88 , srv400742139:88 , srv652667794:88 , srv66944130:88 , srv961262408:88 , srv279822253:89 , srv386542591:89 , srv468114299:89 , srv516935111:89 , srv593253291:89 , srv729697031:89 , srv1089078264:90 , srv1129850842:90 , srv1209475880:90 , srv1813753655:90 , srv2056606793:90 , srv51440515:90 , srv730989086:90 , srv848978047:90 , srv85500755:90 , srv1244224326:93 , srv1460966538:539 }
2023-09-16 19:53:14,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:14,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv324434899=66, srv1735387777=41, srv961262408=98, srv1941112518=50, srv675481961=85, srv2056606793=56, srv652667794=82, srv386542591=69, srv1302091973=15, srv1490125830=29, srv1195058799=10, srv1819791401=45, srv1622791493=37, srv1813753655=44, srv730989086=89, srv2014573622=55, srv85500755=93, srv944328585=97, srv991502259=99, srv516935111=78, srv139181850=20, srv468114299=73, srv1448576165=25, srv1129850842=5, srv1099016538=3, srv787038777=91, srv135705622=18, srv482090796=74, srv1390824636=19, srv1523902921=30, srv106652934=1, srv1919487000=47, srv2147410930=60, srv1154158647=9, srv1997998206=54, srv1696825090=40, srv1209475880=11, srv1569600865=32, srv1221695635=12, srv1244224326=13, srv348223129=67, srv2080267185=58, srv1144311892=8, srv495199735=76, srv74650351=90, srv1349462548=16, srv1598891322=35, srv879752551=95, srv1900763732=46, srv1089078264=2, srv1131051900=6, srv1969126213=51, srv414080867=71, srv712936774=87, srv1599686034=36, srv691381154=86, srv1928836806=49, srv1972130003=53, srv214655672=59, srv1748107998=42, srv1751299595=43, srv1139502034=7, srv51440515=77, srv484949487=75, srv66944130=83, srv1573513349=33, srv1921461517=48, srv1671492561=38, srv729697031=88, srv313046269=64, srv673326451=84, srv1554220574=31, srv279822253=63, srv140482086=21, srv1594205075=34, srv1971042980=52, srv272247539=61, srv400742139=70, srv848978047=92, srv2075849982=57, srv1356517300=17, srv1693215299=39, srv1460966538=26, srv593253291=81, srv1048870564=0, srv57258996=80, srv1436155267=24, srv35995889=68, srv537134665=79, srv1423794559=23, srv1119861729=4, srv440697117=72, srv1287574984=14, srv274516585=62, srv3187337=65, srv935738097=96, srv1488333781=27, srv858548843=94, srv1407144496=22, srv1489512082=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:14,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:14,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-16 19:53:14,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-16 19:53:14,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-16 19:53:14,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-16 19:53:14,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-16 19:53:14,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-16 19:53:14,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-16 19:53:14,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-16 19:53:14,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-16 19:53:14,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-16 19:53:14,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-16 19:53:14,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-16 19:53:14,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-16 19:53:14,809 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02461576531883984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03145909285100027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02461576531883984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:14,809 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-16 19:53:14,810 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016720223936588247, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02461576531883984); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03145909285100027, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02461576531883984); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-16 19:53:15,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.016720223936588247 to a new imbalance of 9.617062385409812E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007014850724684893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007014850724684893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:15,126 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1813753655:83 , srv1969126213:83 , srv1971042980:83 , srv1089078264:84 , srv1244224326:84 , srv1349462548:84 , srv1356517300:84 , srv1436155267:84 , srv1599686034:84 , srv1622791493:84 , srv1671492561:84 , srv1735387777:84 , srv1748107998:84 , srv1819791401:84 , srv1941112518:84 , srv1997998206:84 , srv324434899:84 , srv386542591:84 , srv440697117:84 , srv652667794:84 , srv673326451:84 , srv848978047:84 , srv85500755:84 , srv858548843:84 , srv944328585:84 , srv961262408:84 , srv1048870564:85 , srv106652934:85 , srv1209475880:85 , srv1287574984:85 , srv139181850:85 , srv1407144496:85 , srv1488333781:85 , srv1598891322:85 , srv1693215299:85 , srv1696825090:85 , srv1972130003:85 , srv3187337:85 , srv35995889:85 , srv468114299:85 , srv484949487:85 , srv516935111:85 , srv593253291:85 , srv66944130:85 , srv691381154:85 , srv1119861729:86 , srv1129850842:86 , srv1131051900:86 , srv1144311892:86 , srv1154158647:86 , srv1221695635:86 , srv135705622:86 , srv1390824636:86 , srv140482086:86 , srv1423794559:86 , srv1448576165:86 , srv1489512082:86 , srv1523902921:86 , srv1554220574:86 , srv1573513349:86 , srv1751299595:86 , srv1900763732:86 , srv1919487000:86 , srv2014573622:86 , srv274516585:86 , srv313046269:86 , srv348223129:86 , srv482090796:86 , srv495199735:86 , srv537134665:86 , srv729697031:86 , srv74650351:86 , srv787038777:86 , srv935738097:86 , srv991502259:86 , srv1139502034:87 , srv1302091973:87 , srv1569600865:87 , srv1921461517:87 , srv1928836806:87 , srv2056606793:87 , srv2075849982:87 , srv2080267185:87 , srv2147410930:87 , srv272247539:87 , srv400742139:87 , srv414080867:87 , srv51440515:87 , srv57258996:87 , srv730989086:87 , srv879752551:87 , srv1195058799:88 , srv1490125830:88 , srv1594205075:88 , srv214655672:88 , srv279822253:88 , srv675481961:88 , srv712936774:88 , srv1099016538:89 , srv1460966538:527 }
2023-09-16 19:53:15,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:15,136 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv324434899=66, srv1735387777=41, srv961262408=98, srv1941112518=50, srv675481961=85, srv2056606793=56, srv652667794=82, srv386542591=69, srv1302091973=15, srv1490125830=29, srv1195058799=10, srv1819791401=45, srv1622791493=37, srv1813753655=44, srv730989086=89, srv2014573622=55, srv85500755=93, srv944328585=97, srv991502259=99, srv516935111=78, srv139181850=20, srv468114299=73, srv1448576165=25, srv1129850842=5, srv1099016538=3, srv787038777=91, srv135705622=18, srv482090796=74, srv1390824636=19, srv1523902921=30, srv106652934=1, srv1919487000=47, srv2147410930=60, srv1154158647=9, srv1997998206=54, srv1696825090=40, srv1209475880=11, srv1569600865=32, srv1221695635=12, srv1244224326=13, srv348223129=67, srv2080267185=58, srv1144311892=8, srv495199735=76, srv74650351=90, srv1349462548=16, srv1598891322=35, srv879752551=95, srv1900763732=46, srv1089078264=2, srv1131051900=6, srv1969126213=51, srv414080867=71, srv712936774=87, srv1599686034=36, srv691381154=86, srv1928836806=49, srv1972130003=53, srv214655672=59, srv1748107998=42, srv1751299595=43, srv1139502034=7, srv51440515=77, srv484949487=75, srv66944130=83, srv1573513349=33, srv1921461517=48, srv1671492561=38, srv729697031=88, srv313046269=64, srv673326451=84, srv1554220574=31, srv279822253=63, srv140482086=21, srv1594205075=34, srv1971042980=52, srv272247539=61, srv400742139=70, srv848978047=92, srv2075849982=57, srv1356517300=17, srv1693215299=39, srv1460966538=26, srv593253291=81, srv1048870564=0, srv57258996=80, srv1436155267=24, srv35995889=68, srv537134665=79, srv1423794559=23, srv1119861729=4, srv440697117=72, srv1287574984=14, srv274516585=62, srv3187337=65, srv935738097=96, srv1488333781=27, srv858548843=94, srv1407144496=22, srv1489512082=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:15,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-16 19:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-16 19:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-16 19:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-16 19:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-16 19:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-16 19:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-16 19:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-16 19:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-16 19:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-16 19:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-16 19:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-16 19:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-16 19:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-16 19:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-16 19:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-16 19:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-16 19:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-16 19:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-16 19:53:15,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-16 19:53:15,164 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-16 19:53:15,323 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007014850724684893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007014850724684893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:15,323 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-09-16 19:53:15,330 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.548721404728743E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007014850724684893); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0079561085525314); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007014850724684893); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-09-16 19:53:15,691 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 512 ms to try 5000 different iterations.  Found a solution that moves 282 regions; Going from a computed imbalance of 9.548721404728743E-4 to a new imbalance of 1.1885152386774722E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.03133333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:15,692 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2075849982:82 , srv1099016538:83 , srv1195058799:83 , srv1594205075:83 , srv2147410930:83 , srv3187337:83 , srv414080867:83 , srv1048870564:84 , srv1129850842:84 , srv1131051900:84 , srv1139502034:84 , srv1154158647:84 , srv135705622:84 , srv1390824636:84 , srv139181850:84 , srv1407144496:84 , srv1448576165:84 , srv1523902921:84 , srv1921461517:84 , srv1997998206:84 , srv2056606793:84 , srv2080267185:84 , srv274516585:84 , srv279822253:84 , srv35995889:84 , srv400742139:84 , srv440697117:84 , srv468114299:84 , srv484949487:84 , srv51440515:84 , srv516935111:84 , srv57258996:84 , srv593253291:84 , srv652667794:84 , srv66944130:84 , srv712936774:84 , srv729697031:84 , srv730989086:84 , srv848978047:84 , srv85500755:84 , srv858548843:84 , srv935738097:84 , srv944328585:84 , srv991502259:84 , srv106652934:85 , srv1089078264:85 , srv1119861729:85 , srv1209475880:85 , srv1244224326:85 , srv1287574984:85 , srv1302091973:85 , srv1349462548:85 , srv140482086:85 , srv1436155267:85 , srv1488333781:85 , srv1490125830:85 , srv1554220574:85 , srv1569600865:85 , srv1573513349:85 , srv1598891322:85 , srv1599686034:85 , srv1671492561:85 , srv1693215299:85 , srv1696825090:85 , srv1748107998:85 , srv1751299595:85 , srv1819791401:85 , srv1900763732:85 , srv1919487000:85 , srv1928836806:85 , srv1941112518:85 , srv2014573622:85 , srv214655672:85 , srv272247539:85 , srv313046269:85 , srv324434899:85 , srv348223129:85 , srv386542591:85 , srv482090796:85 , srv495199735:85 , srv537134665:85 , srv675481961:85 , srv691381154:85 , srv74650351:85 , srv787038777:85 , srv961262408:85 , srv1144311892:86 , srv1221695635:86 , srv1356517300:86 , srv1423794559:86 , srv1489512082:86 , srv1622791493:86 , srv1813753655:86 , srv1969126213:86 , srv1971042980:86 , srv1972130003:86 , srv879752551:86 , srv1735387777:87 , srv673326451:87 , srv1460966538:622 }
2023-09-16 19:53:15,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:15,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv324434899=66, srv1735387777=41, srv961262408=98, srv1941112518=50, srv675481961=85, srv2056606793=56, srv652667794=82, srv386542591=69, srv1302091973=15, srv1490125830=29, srv1195058799=10, srv1819791401=45, srv1622791493=37, srv1813753655=44, srv730989086=89, srv2014573622=55, srv85500755=93, srv944328585=97, srv991502259=99, srv516935111=78, srv139181850=20, srv468114299=73, srv1448576165=25, srv1129850842=5, srv1099016538=3, srv787038777=91, srv135705622=18, srv482090796=74, srv1390824636=19, srv1523902921=30, srv106652934=1, srv1919487000=47, srv2147410930=60, srv1154158647=9, srv1997998206=54, srv1696825090=40, srv1209475880=11, srv1569600865=32, srv1221695635=12, srv1244224326=13, srv348223129=67, srv2080267185=58, srv1144311892=8, srv495199735=76, srv74650351=90, srv1349462548=16, srv1598891322=35, srv879752551=95, srv1900763732=46, srv1089078264=2, srv1131051900=6, srv1969126213=51, srv414080867=71, srv712936774=87, srv1599686034=36, srv691381154=86, srv1928836806=49, srv1972130003=53, srv214655672=59, srv1748107998=42, srv1751299595=43, srv1139502034=7, srv51440515=77, srv484949487=75, srv66944130=83, srv1573513349=33, srv1921461517=48, srv1671492561=38, srv729697031=88, srv313046269=64, srv673326451=84, srv1554220574=31, srv279822253=63, srv140482086=21, srv1594205075=34, srv1971042980=52, srv272247539=61, srv400742139=70, srv848978047=92, srv2075849982=57, srv1356517300=17, srv1693215299=39, srv1460966538=26, srv593253291=81, srv1048870564=0, srv57258996=80, srv1436155267=24, srv35995889=68, srv537134665=79, srv1423794559=23, srv1119861729=4, srv440697117=72, srv1287574984=14, srv274516585=62, srv3187337=65, srv935738097=96, srv1488333781=27, srv858548843=94, srv1407144496=22, srv1489512082=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:15,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:15,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:15,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:15,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:15,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:15,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-09-16 19:53:15,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-09-16 19:53:15,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-09-16 19:53:15,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-09-16 19:53:15,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-09-16 19:53:15,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-09-16 19:53:15,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-09-16 19:53:15,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-09-16 19:53:15,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-09-16 19:53:15,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-09-16 19:53:15,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-09-16 19:53:15,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-09-16 19:53:15,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.910546182670062E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.23782800878924E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.23782800878924E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:15,840 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv2075849982:82 , srv1099016538:83 , srv1195058799:83 , srv1594205075:83 , srv2147410930:83 , srv3187337:83 , srv414080867:83 , srv1048870564:84 , srv1129850842:84 , srv1131051900:84 , srv1139502034:84 , srv1154158647:84 , srv135705622:84 , srv1390824636:84 , srv139181850:84 , srv1407144496:84 , srv1448576165:84 , srv1523902921:84 , srv1921461517:84 , srv1997998206:84 , srv2056606793:84 , srv2080267185:84 , srv274516585:84 , srv279822253:84 , srv35995889:84 , srv400742139:84 , srv440697117:84 , srv468114299:84 , srv484949487:84 , srv51440515:84 , srv516935111:84 , srv57258996:84 , srv593253291:84 , srv652667794:84 , srv66944130:84 , srv712936774:84 , srv729697031:84 , srv730989086:84 , srv848978047:84 , srv85500755:84 , srv858548843:84 , srv935738097:84 , srv944328585:84 , srv991502259:84 , srv106652934:85 , srv1089078264:85 , srv1119861729:85 , srv1209475880:85 , srv1244224326:85 , srv1287574984:85 , srv1302091973:85 , srv1349462548:85 , srv140482086:85 , srv1436155267:85 , srv1488333781:85 , srv1490125830:85 , srv1554220574:85 , srv1569600865:85 , srv1573513349:85 , srv1598891322:85 , srv1599686034:85 , srv1671492561:85 , srv1693215299:85 , srv1696825090:85 , srv1748107998:85 , srv1751299595:85 , srv1819791401:85 , srv1900763732:85 , srv1919487000:85 , srv1928836806:85 , srv1941112518:85 , srv2014573622:85 , srv214655672:85 , srv272247539:85 , srv313046269:85 , srv324434899:85 , srv348223129:85 , srv386542591:85 , srv482090796:85 , srv495199735:85 , srv537134665:85 , srv675481961:85 , srv691381154:85 , srv74650351:85 , srv787038777:85 , srv961262408:85 , srv1144311892:86 , srv1221695635:86 , srv1356517300:86 , srv1423794559:86 , srv1489512082:86 , srv1622791493:86 , srv1813753655:86 , srv1969126213:86 , srv1971042980:86 , srv1972130003:86 , srv879752551:86 , srv1735387777:87 , srv673326451:87 , srv1460966538:622 }
2023-09-16 19:53:15,873 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 248) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=8297 (was 8922)
2023-09-16 19:53:15,881 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=174, AvailableMemoryMB=8297
2023-09-16 19:53:15,882 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-09-16 19:53:15,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-09-16 19:53:15,895 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1052920873:84 , srv1054678956:84 , srv1074505241:84 , srv1114556233:84 , srv1155383899:84 , srv1213313887:84 , srv1357624254:84 , srv1403288399:84 , srv1642718945:84 , srv1772071852:84 , srv1843847293:84 , srv2044738882:84 , srv2046434388:84 , srv2046686334:84 , srv261004600:84 , srv292703501:84 , srv317398394:84 , srv337574580:84 , srv50706742:84 , srv530569021:84 , srv593135777:84 , srv629544988:84 , srv644481314:84 , srv702724310:84 , srv712921155:84 , srv75551837:84 , srv832555406:84 , srv906067041:84 , srv964487465:84 , srv578060496:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-09-16 19:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:53:15,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1772071852=9, srv712921155=25, srv1052920873=0, srv1843847293=10, srv530569021=19, srv317398394=16, srv1642718945=8, srv2046434388=12, srv261004600=14, srv702724310=24, srv1403288399=7, srv2044738882=11, srv629544988=22, srv337574580=17, srv1155383899=4, srv2046686334=13, srv1114556233=3, srv964487465=29, srv1213313887=5, srv1074505241=2, srv1357624254=6, srv593135777=21, srv1054678956=1, srv50706742=18, srv578060496=20, srv75551837=26, srv832555406=27, srv906067041=28, srv292703501=15, srv644481314=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:53:15,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:53:15,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:53:15,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:53:15,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-16 19:53:15,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1298469043979344, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:53:15,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912602186620145, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1298469043979344, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-09-16 19:55:15,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6403030 different iterations.  Found a solution that moves 1844 regions; Going from a computed imbalance of 0.9912602186620145 to a new imbalance of 4.303987990979898E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.682962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:55:15,922 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1052920873:90 , srv1054678956:90 , srv1074505241:90 , srv1114556233:90 , srv1155383899:90 , srv1213313887:90 , srv1357624254:90 , srv1403288399:90 , srv1642718945:90 , srv1772071852:90 , srv1843847293:90 , srv2044738882:90 , srv2046434388:90 , srv2046686334:90 , srv261004600:90 , srv292703501:90 , srv317398394:90 , srv337574580:90 , srv50706742:90 , srv530569021:90 , srv578060496:90 , srv593135777:90 , srv629544988:90 , srv644481314:90 , srv702724310:90 , srv712921155:90 , srv75551837:90 , srv832555406:90 , srv906067041:90 , srv964487465:90 }
2023-09-16 19:55:15,923 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-09-16 19:55:15,924 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1772071852=9, srv712921155=25, srv1052920873=0, srv1843847293=10, srv530569021=19, srv317398394=16, srv1642718945=8, srv2046434388=12, srv261004600=14, srv702724310=24, srv1403288399=7, srv2044738882=11, srv629544988=22, srv337574580=17, srv1155383899=4, srv2046686334=13, srv1114556233=3, srv964487465=29, srv1213313887=5, srv1074505241=2, srv1357624254=6, srv593135777=21, srv1054678956=1, srv50706742=18, srv578060496=20, srv75551837=26, srv832555406=27, srv906067041=28, srv292703501=15, srv644481314=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-09-16 19:55:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-09-16 19:55:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-09-16 19:55:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-09-16 19:55:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-09-16 19:55:15,927 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-09-16 19:55:15,928 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-09-16 19:55:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-09-16 19:55:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-09-16 19:55:15,929 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-09-16 19:55:15,941 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-09-16 19:55:15,941 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1052920873:90 , srv1054678956:90 , srv1074505241:90 , srv1114556233:90 , srv1155383899:90 , srv1213313887:90 , srv1357624254:90 , srv1403288399:90 , srv1642718945:90 , srv1772071852:90 , srv1843847293:90 , srv2044738882:90 , srv2046434388:90 , srv2046686334:90 , srv261004600:90 , srv292703501:90 , srv317398394:90 , srv337574580:90 , srv50706742:90 , srv530569021:90 , srv578060496:90 , srv593135777:90 , srv629544988:90 , srv644481314:90 , srv702724310:90 , srv712921155:90 , srv75551837:90 , srv832555406:90 , srv906067041:90 , srv964487465:90 }
2023-09-16 19:55:15,957 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=163 (was 284), ProcessCount=171 (was 174), AvailableMemoryMB=6882 (was 8297)