2023-05-12 22:53:23,883 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-12 22:53:24,215 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-12 22:53:24,338 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-12 22:53:24,399 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-12 22:53:24,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-12 22:53:24,422 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=172, AvailableMemoryMB=10144
2023-05-12 22:53:24,424 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-12 22:53:24,425 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-12 22:53:24,566 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000672389:84 , srv1009644259:84 , srv104558611:84 , srv1069582734:84 , srv1080184002:84 , srv1089203214:84 , srv1121871496:84 , srv1136537645:84 , srv1148865058:84 , srv1155795612:84 , srv1207065556:84 , srv1331477400:84 , srv1383022976:84 , srv1400648322:84 , srv14080078:84 , srv141242252:84 , srv1428982802:84 , srv1432272519:84 , srv145230686:84 , srv1455433350:84 , srv1483346074:84 , srv1496240939:84 , srv151777842:84 , srv1545425001:84 , srv1563182144:84 , srv1582168254:84 , srv1597012616:84 , srv1609205487:84 , srv1653599849:84 , srv1656706168:84 , srv166197712:84 , srv166557960:84 , srv1684464414:84 , srv1702647977:84 , srv1737143613:84 , srv1744048635:84 , srv1766914695:84 , srv1772929156:84 , srv1774537738:84 , srv1791879774:84 , srv18114997:84 , srv1834440157:84 , srv1846126528:84 , srv1861934717:84 , srv1869307242:84 , srv1871566196:84 , srv1872462813:84 , srv1882294659:84 , srv1883122500:84 , srv1907234775:84 , srv1923718452:84 , srv1928225713:84 , srv1934904814:84 , srv1972826142:84 , srv1986901418:84 , srv1993721883:84 , srv1996895079:84 , srv2034204360:84 , srv2044096764:84 , srv2048402693:84 , srv2058774382:84 , srv2114054549:84 , srv215241217:84 , srv267748481:84 , srv294390311:84 , srv317990644:84 , srv386268353:84 , srv423455510:84 , srv436797022:84 , srv459568589:84 , srv470552829:84 , srv471726828:84 , srv49920849:84 , srv513688644:84 , srv514882373:84 , srv553006721:84 , srv574021882:84 , srv576085397:84 , srv582658614:84 , srv596794640:84 , srv599152011:84 , srv601614667:84 , srv606711826:84 , srv613019857:84 , srv627732605:84 , srv630795324:84 , srv631035667:84 , srv687575670:84 , srv728042242:84 , srv750278491:84 , srv755684007:84 , srv779107832:84 , srv820451764:84 , srv826414847:84 , srv844607603:84 , srv907019158:84 , srv943168308:84 , srv971966513:84 , srv988843113:84 , srv996325501:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-12 22:53:24,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:24,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1972826142=53, srv1597012616=26, srv907019158=95, srv1653599849=28, srv631035667=86, srv1331477400=11, srv1080184002=4, srv1766914695=36, srv1207065556=10, srv574021882=76, srv1148865058=8, srv436797022=68, srv779107832=91, srv1121871496=6, srv1582168254=25, srv145230686=18, srv1907234775=49, srv820451764=92, srv1737143613=34, srv1009644259=1, srv14080078=14, srv553006721=75, srv2114054549=61, srv750278491=89, srv1563182144=24, srv1400648322=13, srv1744048635=35, srv1089203214=5, srv943168308=96, srv104558611=2, srv1834440157=41, srv141242252=15, srv1791879774=39, srv1846126528=42, srv459568589=69, srv215241217=62, srv1934904814=52, srv606711826=82, srv1432272519=17, srv1000672389=0, srv1882294659=47, srv513688644=73, srv582658614=78, srv601614667=81, srv1496240939=21, srv1483346074=20, srv1923718452=50, srv166197712=30, srv1986901418=54, srv470552829=70, srv2044096764=58, srv166557960=31, srv687575670=87, srv1383022976=12, srv1428982802=16, srv1928225713=51, srv514882373=74, srv844607603=94, srv423455510=67, srv1869307242=44, srv596794640=79, srv1609205487=27, srv1871566196=45, srv1702647977=33, srv576085397=77, srv996325501=99, srv1155795612=9, srv1455433350=19, srv18114997=40, srv294390311=64, srv971966513=97, srv988843113=98, srv1883122500=48, srv1069582734=3, srv317990644=65, srv267748481=63, srv755684007=90, srv1684464414=32, srv728042242=88, srv1772929156=37, srv1993721883=55, srv1996895079=56, srv471726828=71, srv613019857=83, srv826414847=93, srv627732605=84, srv1545425001=23, srv1872462813=46, srv386268353=66, srv599152011=80, srv2034204360=57, srv630795324=85, srv2048402693=59, srv1656706168=29, srv2058774382=60, srv49920849=72, srv151777842=22, srv1136537645=7, srv1861934717=43, srv1774537738=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:24,706 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:24,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:24,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:24,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:24,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:24,708 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:24,709 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:24,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:24,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-12 22:53:24,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-12 22:53:24,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-12 22:53:24,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-12 22:53:24,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-12 22:53:24,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-12 22:53:24,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-12 22:53:24,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-12 22:53:24,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-12 22:53:24,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-12 22:53:24,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-12 22:53:24,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:24,938 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-12 22:53:24,938 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-12 22:53:25,761 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1007 ms to try 5000 different iterations.  Found a solution that moves 4621 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.19270463684091535. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040103059651859216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05500739670699168, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5134444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040103059651859216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18841666666666668, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2510833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:25,789 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1766914695:80 , srv582658614:80 , srv145230686:82 , srv1656706168:82 , srv1772929156:82 , srv2058774382:82 , srv2114054549:82 , srv971966513:82 , srv1080184002:83 , srv1483346074:83 , srv151777842:83 , srv1702647977:83 , srv18114997:83 , srv1869307242:83 , srv1907234775:83 , srv1986901418:83 , srv459568589:83 , srv750278491:83 , srv1400648322:84 , srv1582168254:84 , srv1737143613:84 , srv2048402693:84 , srv294390311:84 , srv317990644:84 , srv436797022:84 , srv470552829:84 , srv631035667:84 , srv820451764:84 , srv943168308:84 , srv1009644259:85 , srv1089203214:85 , srv1432272519:85 , srv1563182144:85 , srv1846126528:85 , srv1871566196:85 , srv1872462813:85 , srv1928225713:85 , srv2034204360:85 , srv267748481:85 , srv687575670:85 , srv1000672389:86 , srv1331477400:86 , srv1545425001:86 , srv1653599849:86 , srv166557960:86 , srv1774537738:86 , srv1882294659:86 , srv1883122500:86 , srv1972826142:86 , srv2044096764:86 , srv386268353:86 , srv514882373:86 , srv576085397:86 , srv599152011:86 , srv627732605:86 , srv826414847:86 , srv1148865058:87 , srv14080078:87 , srv141242252:87 , srv1496240939:87 , srv166197712:87 , srv1684464414:87 , srv1861934717:87 , srv1934904814:87 , srv1993721883:87 , srv423455510:87 , srv601614667:87 , srv613019857:87 , srv988843113:87 , srv104558611:88 , srv1834440157:88 , srv49920849:88 , srv513688644:88 , srv574021882:88 , srv728042242:88 , srv1155795612:89 , srv1207065556:89 , srv1455433350:89 , srv1597012616:89 , srv1923718452:89 , srv1996895079:89 , srv755684007:89 , srv1428982802:90 , srv1609205487:90 , srv1744048635:90 , srv471726828:90 , srv606711826:90 , srv630795324:90 , srv1069582734:91 , srv1121871496:91 , srv1791879774:91 , srv779107832:91 , srv844607603:91 , srv1383022976:92 , srv907019158:92 , srv1136537645:93 , srv596794640:93 , srv215241217:95 , srv553006721:95 , srv996325501:446 }
2023-05-12 22:53:25,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:25,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1972826142=53, srv1597012616=26, srv907019158=95, srv1653599849=28, srv631035667=86, srv1331477400=11, srv1080184002=4, srv1766914695=36, srv1207065556=10, srv574021882=76, srv1148865058=8, srv436797022=68, srv779107832=91, srv1121871496=6, srv1582168254=25, srv145230686=18, srv1907234775=49, srv820451764=92, srv1737143613=34, srv1009644259=1, srv14080078=14, srv553006721=75, srv2114054549=61, srv750278491=89, srv1563182144=24, srv1400648322=13, srv1744048635=35, srv1089203214=5, srv943168308=96, srv104558611=2, srv1834440157=41, srv141242252=15, srv1791879774=39, srv1846126528=42, srv459568589=69, srv215241217=62, srv1934904814=52, srv606711826=82, srv1432272519=17, srv1000672389=0, srv1882294659=47, srv513688644=73, srv582658614=78, srv601614667=81, srv1496240939=21, srv1483346074=20, srv1923718452=50, srv166197712=30, srv1986901418=54, srv470552829=70, srv2044096764=58, srv166557960=31, srv687575670=87, srv1383022976=12, srv1428982802=16, srv1928225713=51, srv514882373=74, srv844607603=94, srv423455510=67, srv1869307242=44, srv596794640=79, srv1609205487=27, srv1871566196=45, srv1702647977=33, srv576085397=77, srv996325501=99, srv1155795612=9, srv1455433350=19, srv18114997=40, srv294390311=64, srv971966513=97, srv988843113=98, srv1883122500=48, srv1069582734=3, srv317990644=65, srv267748481=63, srv755684007=90, srv1684464414=32, srv728042242=88, srv1772929156=37, srv1993721883=55, srv1996895079=56, srv471726828=71, srv613019857=83, srv826414847=93, srv627732605=84, srv1545425001=23, srv1872462813=46, srv386268353=66, srv599152011=80, srv2034204360=57, srv630795324=85, srv2048402693=59, srv1656706168=29, srv2058774382=60, srv49920849=72, srv151777842=22, srv1136537645=7, srv1861934717=43, srv1774537738=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:25,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:25,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:25,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-12 22:53:25,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-12 22:53:25,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-12 22:53:25,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-12 22:53:25,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-12 22:53:25,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-12 22:53:25,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-12 22:53:26,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040103059651859216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05500739670699168, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040103059651859216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18841666666666668, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2510833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:26,008 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-12 22:53:26,009 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1926722799073367, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040103059651859216, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05500739670699168, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040103059651859216, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18841666666666668, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2510833333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-12 22:53:26,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 479 ms to try 5000 different iterations.  Found a solution that moves 2633 regions; Going from a computed imbalance of 0.1926722799073367 to a new imbalance of 0.01877820089708786. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023296695087399438); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034295867237027884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29255555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023296695087399438); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04958333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:26,351 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1136537645:78 , srv553006721:78 , srv1121871496:79 , srv1383022976:79 , srv596794640:79 , srv606711826:79 , srv215241217:80 , srv779107832:80 , srv1155795612:81 , srv1597012616:81 , srv1609205487:81 , srv471726828:81 , srv907019158:81 , srv1069582734:82 , srv1428982802:82 , srv1791879774:82 , srv104558611:83 , srv1148865058:83 , srv1207065556:83 , srv14080078:83 , srv141242252:83 , srv1834440157:83 , srv1993721883:83 , srv574021882:83 , srv601614667:83 , srv755684007:83 , srv844607603:83 , srv988843113:83 , srv1496240939:84 , srv1563182144:84 , srv1744048635:84 , srv1923718452:84 , srv1934904814:84 , srv1996895079:84 , srv49920849:84 , srv514882373:84 , srv630795324:84 , srv1331477400:85 , srv1545425001:85 , srv1582168254:85 , srv1861934717:85 , srv267748481:85 , srv423455510:85 , srv576085397:85 , srv599152011:85 , srv613019857:85 , srv1432272519:86 , srv1455433350:86 , srv1653599849:86 , srv166557960:86 , srv1684464414:86 , srv1737143613:86 , srv1774537738:86 , srv1972826142:86 , srv470552829:86 , srv627732605:86 , srv728042242:86 , srv943168308:86 , srv1000672389:87 , srv1400648322:87 , srv166197712:87 , srv1928225713:87 , srv1986901418:87 , srv2044096764:87 , srv2048402693:87 , srv317990644:87 , srv436797022:87 , srv513688644:87 , srv1009644259:88 , srv1080184002:88 , srv1089203214:88 , srv151777842:88 , srv18114997:88 , srv1846126528:88 , srv1871566196:88 , srv1882294659:88 , srv1883122500:88 , srv2034204360:88 , srv386268353:88 , srv459568589:88 , srv631035667:88 , srv820451764:88 , srv145230686:89 , srv1869307242:89 , srv1872462813:89 , srv2058774382:89 , srv294390311:89 , srv582658614:89 , srv1483346074:90 , srv1656706168:90 , srv1702647977:90 , srv1772929156:90 , srv687575670:90 , srv750278491:90 , srv826414847:90 , srv1907234775:91 , srv2114054549:91 , srv1766914695:92 , srv971966513:93 , srv996325501:535 }
2023-05-12 22:53:26,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:26,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1972826142=53, srv1597012616=26, srv907019158=95, srv1653599849=28, srv631035667=86, srv1331477400=11, srv1080184002=4, srv1766914695=36, srv1207065556=10, srv574021882=76, srv1148865058=8, srv436797022=68, srv779107832=91, srv1121871496=6, srv1582168254=25, srv145230686=18, srv1907234775=49, srv820451764=92, srv1737143613=34, srv1009644259=1, srv14080078=14, srv553006721=75, srv2114054549=61, srv750278491=89, srv1563182144=24, srv1400648322=13, srv1744048635=35, srv1089203214=5, srv943168308=96, srv104558611=2, srv1834440157=41, srv141242252=15, srv1791879774=39, srv1846126528=42, srv459568589=69, srv215241217=62, srv1934904814=52, srv606711826=82, srv1432272519=17, srv1000672389=0, srv1882294659=47, srv513688644=73, srv582658614=78, srv601614667=81, srv1496240939=21, srv1483346074=20, srv1923718452=50, srv166197712=30, srv1986901418=54, srv470552829=70, srv2044096764=58, srv166557960=31, srv687575670=87, srv1383022976=12, srv1428982802=16, srv1928225713=51, srv514882373=74, srv844607603=94, srv423455510=67, srv1869307242=44, srv596794640=79, srv1609205487=27, srv1871566196=45, srv1702647977=33, srv576085397=77, srv996325501=99, srv1155795612=9, srv1455433350=19, srv18114997=40, srv294390311=64, srv971966513=97, srv988843113=98, srv1883122500=48, srv1069582734=3, srv317990644=65, srv267748481=63, srv755684007=90, srv1684464414=32, srv728042242=88, srv1772929156=37, srv1993721883=55, srv1996895079=56, srv471726828=71, srv613019857=83, srv826414847=93, srv627732605=84, srv1545425001=23, srv1872462813=46, srv386268353=66, srv599152011=80, srv2034204360=57, srv630795324=85, srv2048402693=59, srv1656706168=29, srv2058774382=60, srv49920849=72, srv151777842=22, srv1136537645=7, srv1861934717=43, srv1774537738=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:26,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:26,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-12 22:53:26,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-12 22:53:26,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-12 22:53:26,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-12 22:53:26,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-12 22:53:26,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-12 22:53:26,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-12 22:53:26,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-12 22:53:26,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-12 22:53:26,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-12 22:53:26,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-12 22:53:26,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-12 22:53:26,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-12 22:53:26,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023296695087399438); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034295867237027884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023296695087399438); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04958333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:26,490 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-12 22:53:26,490 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01875976423703322, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023296695087399438); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034295867237027884, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023296695087399438); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.015583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04958333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-12 22:53:26,784 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 390 ms to try 5000 different iterations.  Found a solution that moves 1069 regions; Going from a computed imbalance of 0.01875976423703322 to a new imbalance of 5.933351172068931E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010023043657747274); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011090890691968327); MoveCostFunction : (multiplier=7.0, imbalance=0.11877777777777777, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010023043657747274); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:26,786 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv513688644:82 , srv630795324:82 , srv687575670:82 , srv826414847:82 , srv844607603:82 , srv1455433350:83 , srv166197712:83 , srv1882294659:83 , srv1883122500:83 , srv1907234775:83 , srv1996895079:83 , srv215241217:83 , srv386268353:83 , srv553006721:83 , srv971966513:83 , srv1000672389:84 , srv1009644259:84 , srv1069582734:84 , srv1089203214:84 , srv1428982802:84 , srv1483346074:84 , srv1684464414:84 , srv1744048635:84 , srv1791879774:84 , srv1846126528:84 , srv1871566196:84 , srv1872462813:84 , srv1928225713:84 , srv2034204360:84 , srv2114054549:84 , srv294390311:84 , srv423455510:84 , srv613019857:84 , srv627732605:84 , srv750278491:84 , srv820451764:84 , srv907019158:84 , srv104558611:85 , srv1080184002:85 , srv1383022976:85 , srv1656706168:85 , srv166557960:85 , srv1702647977:85 , srv1766914695:85 , srv1774537738:85 , srv18114997:85 , srv1869307242:85 , srv1923718452:85 , srv574021882:85 , srv631035667:85 , srv728042242:85 , srv755684007:85 , srv1155795612:86 , srv1207065556:86 , srv1331477400:86 , srv1400648322:86 , srv145230686:86 , srv151777842:86 , srv1597012616:86 , srv1609205487:86 , srv1653599849:86 , srv1772929156:86 , srv1834440157:86 , srv1972826142:86 , srv1986901418:86 , srv2044096764:86 , srv2048402693:86 , srv2058774382:86 , srv267748481:86 , srv317990644:86 , srv436797022:86 , srv471726828:86 , srv49920849:86 , srv576085397:86 , srv596794640:86 , srv599152011:86 , srv779107832:86 , srv943168308:86 , srv1121871496:87 , srv1136537645:87 , srv1148865058:87 , srv141242252:87 , srv1432272519:87 , srv1496240939:87 , srv1545425001:87 , srv1737143613:87 , srv1861934717:87 , srv1934904814:87 , srv1993721883:87 , srv459568589:87 , srv470552829:87 , srv988843113:87 , srv14080078:88 , srv1582168254:88 , srv514882373:88 , srv582658614:88 , srv601614667:88 , srv606711826:88 , srv1563182144:89 , srv996325501:566 }
2023-05-12 22:53:26,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:26,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1972826142=53, srv1597012616=26, srv907019158=95, srv1653599849=28, srv631035667=86, srv1331477400=11, srv1080184002=4, srv1766914695=36, srv1207065556=10, srv574021882=76, srv1148865058=8, srv436797022=68, srv779107832=91, srv1121871496=6, srv1582168254=25, srv145230686=18, srv1907234775=49, srv820451764=92, srv1737143613=34, srv1009644259=1, srv14080078=14, srv553006721=75, srv2114054549=61, srv750278491=89, srv1563182144=24, srv1400648322=13, srv1744048635=35, srv1089203214=5, srv943168308=96, srv104558611=2, srv1834440157=41, srv141242252=15, srv1791879774=39, srv1846126528=42, srv459568589=69, srv215241217=62, srv1934904814=52, srv606711826=82, srv1432272519=17, srv1000672389=0, srv1882294659=47, srv513688644=73, srv582658614=78, srv601614667=81, srv1496240939=21, srv1483346074=20, srv1923718452=50, srv166197712=30, srv1986901418=54, srv470552829=70, srv2044096764=58, srv166557960=31, srv687575670=87, srv1383022976=12, srv1428982802=16, srv1928225713=51, srv514882373=74, srv844607603=94, srv423455510=67, srv1869307242=44, srv596794640=79, srv1609205487=27, srv1871566196=45, srv1702647977=33, srv576085397=77, srv996325501=99, srv1155795612=9, srv1455433350=19, srv18114997=40, srv294390311=64, srv971966513=97, srv988843113=98, srv1883122500=48, srv1069582734=3, srv317990644=65, srv267748481=63, srv755684007=90, srv1684464414=32, srv728042242=88, srv1772929156=37, srv1993721883=55, srv1996895079=56, srv471726828=71, srv613019857=83, srv826414847=93, srv627732605=84, srv1545425001=23, srv1872462813=46, srv386268353=66, srv599152011=80, srv2034204360=57, srv630795324=85, srv2048402693=59, srv1656706168=29, srv2058774382=60, srv49920849=72, srv151777842=22, srv1136537645=7, srv1861934717=43, srv1774537738=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:26,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:26,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-12 22:53:26,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-12 22:53:26,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-12 22:53:26,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-12 22:53:26,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-12 22:53:26,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-12 22:53:26,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-12 22:53:26,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-12 22:53:26,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-12 22:53:26,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-12 22:53:26,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010023043657747274); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011090890691968327); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010023043657747274); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:26,967 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-12 22:53:26,967 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.858498192204113E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010023043657747274); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011090890691968327); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.010023043657747274); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-12 22:53:27,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 399 ms to try 5000 different iterations.  Found a solution that moves 310 regions; Going from a computed imbalance of 5.858498192204113E-4 to a new imbalance of 2.1492471746287064E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.034444444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:27,250 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1563182144:83 , srv1861934717:83 , srv2044096764:83 , srv1136537645:84 , srv1207065556:84 , srv1331477400:84 , srv14080078:84 , srv1432272519:84 , srv1455433350:84 , srv1496240939:84 , srv1545425001:84 , srv1653599849:84 , srv1702647977:84 , srv1744048635:84 , srv1772929156:84 , srv1869307242:84 , srv1871566196:84 , srv1923718452:84 , srv1934904814:84 , srv1972826142:84 , srv215241217:84 , srv49920849:84 , srv514882373:84 , srv596794640:84 , srv601614667:84 , srv631035667:84 , srv728042242:84 , srv826414847:84 , srv971966513:84 , srv1000672389:85 , srv1009644259:85 , srv1069582734:85 , srv1089203214:85 , srv1121871496:85 , srv1148865058:85 , srv1400648322:85 , srv141242252:85 , srv145230686:85 , srv1483346074:85 , srv1582168254:85 , srv1609205487:85 , srv1656706168:85 , srv166197712:85 , srv166557960:85 , srv1684464414:85 , srv1737143613:85 , srv1766914695:85 , srv1774537738:85 , srv1791879774:85 , srv1834440157:85 , srv1846126528:85 , srv1872462813:85 , srv1882294659:85 , srv1883122500:85 , srv1907234775:85 , srv1993721883:85 , srv2034204360:85 , srv2048402693:85 , srv2058774382:85 , srv267748481:85 , srv294390311:85 , srv317990644:85 , srv386268353:85 , srv436797022:85 , srv459568589:85 , srv470552829:85 , srv471726828:85 , srv513688644:85 , srv582658614:85 , srv599152011:85 , srv606711826:85 , srv613019857:85 , srv627732605:85 , srv687575670:85 , srv750278491:85 , srv755684007:85 , srv779107832:85 , srv820451764:85 , srv907019158:85 , srv988843113:85 , srv104558611:86 , srv1155795612:86 , srv1383022976:86 , srv151777842:86 , srv18114997:86 , srv1928225713:86 , srv1986901418:86 , srv1996895079:86 , srv2114054549:86 , srv423455510:86 , srv553006721:86 , srv574021882:86 , srv576085397:86 , srv630795324:86 , srv844607603:86 , srv943168308:86 , srv1080184002:87 , srv1428982802:87 , srv1597012616:87 , srv996325501:595 }
2023-05-12 22:53:27,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:27,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1972826142=53, srv1597012616=26, srv907019158=95, srv1653599849=28, srv631035667=86, srv1331477400=11, srv1080184002=4, srv1766914695=36, srv1207065556=10, srv574021882=76, srv1148865058=8, srv436797022=68, srv779107832=91, srv1121871496=6, srv1582168254=25, srv145230686=18, srv1907234775=49, srv820451764=92, srv1737143613=34, srv1009644259=1, srv14080078=14, srv553006721=75, srv2114054549=61, srv750278491=89, srv1563182144=24, srv1400648322=13, srv1744048635=35, srv1089203214=5, srv943168308=96, srv104558611=2, srv1834440157=41, srv141242252=15, srv1791879774=39, srv1846126528=42, srv459568589=69, srv215241217=62, srv1934904814=52, srv606711826=82, srv1432272519=17, srv1000672389=0, srv1882294659=47, srv513688644=73, srv582658614=78, srv601614667=81, srv1496240939=21, srv1483346074=20, srv1923718452=50, srv166197712=30, srv1986901418=54, srv470552829=70, srv2044096764=58, srv166557960=31, srv687575670=87, srv1383022976=12, srv1428982802=16, srv1928225713=51, srv514882373=74, srv844607603=94, srv423455510=67, srv1869307242=44, srv596794640=79, srv1609205487=27, srv1871566196=45, srv1702647977=33, srv576085397=77, srv996325501=99, srv1155795612=9, srv1455433350=19, srv18114997=40, srv294390311=64, srv971966513=97, srv988843113=98, srv1883122500=48, srv1069582734=3, srv317990644=65, srv267748481=63, srv755684007=90, srv1684464414=32, srv728042242=88, srv1772929156=37, srv1993721883=55, srv1996895079=56, srv471726828=71, srv613019857=83, srv826414847=93, srv627732605=84, srv1545425001=23, srv1872462813=46, srv386268353=66, srv599152011=80, srv2034204360=57, srv630795324=85, srv2048402693=59, srv1656706168=29, srv2058774382=60, srv49920849=72, srv151777842=22, srv1136537645=7, srv1861934717=43, srv1774537738=38} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:27,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:27,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:27,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-12 22:53:27,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-12 22:53:27,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-12 22:53:27,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-12 22:53:27,275 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-12 22:53:27,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-12 22:53:27,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-12 22:53:27,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-12 22:53:27,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-12 22:53:27,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-12 22:53:27,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-12 22:53:27,398 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.932180535170393E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:27,399 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1563182144:83 , srv1861934717:83 , srv2044096764:83 , srv1136537645:84 , srv1207065556:84 , srv1331477400:84 , srv14080078:84 , srv1432272519:84 , srv1455433350:84 , srv1496240939:84 , srv1545425001:84 , srv1653599849:84 , srv1702647977:84 , srv1744048635:84 , srv1772929156:84 , srv1869307242:84 , srv1871566196:84 , srv1923718452:84 , srv1934904814:84 , srv1972826142:84 , srv215241217:84 , srv49920849:84 , srv514882373:84 , srv596794640:84 , srv601614667:84 , srv631035667:84 , srv728042242:84 , srv826414847:84 , srv971966513:84 , srv1000672389:85 , srv1009644259:85 , srv1069582734:85 , srv1089203214:85 , srv1121871496:85 , srv1148865058:85 , srv1400648322:85 , srv141242252:85 , srv145230686:85 , srv1483346074:85 , srv1582168254:85 , srv1609205487:85 , srv1656706168:85 , srv166197712:85 , srv166557960:85 , srv1684464414:85 , srv1737143613:85 , srv1766914695:85 , srv1774537738:85 , srv1791879774:85 , srv1834440157:85 , srv1846126528:85 , srv1872462813:85 , srv1882294659:85 , srv1883122500:85 , srv1907234775:85 , srv1993721883:85 , srv2034204360:85 , srv2048402693:85 , srv2058774382:85 , srv267748481:85 , srv294390311:85 , srv317990644:85 , srv386268353:85 , srv436797022:85 , srv459568589:85 , srv470552829:85 , srv471726828:85 , srv513688644:85 , srv582658614:85 , srv599152011:85 , srv606711826:85 , srv613019857:85 , srv627732605:85 , srv687575670:85 , srv750278491:85 , srv755684007:85 , srv779107832:85 , srv820451764:85 , srv907019158:85 , srv988843113:85 , srv104558611:86 , srv1155795612:86 , srv1383022976:86 , srv151777842:86 , srv18114997:86 , srv1928225713:86 , srv1986901418:86 , srv1996895079:86 , srv2114054549:86 , srv423455510:86 , srv553006721:86 , srv574021882:86 , srv576085397:86 , srv630795324:86 , srv844607603:86 , srv943168308:86 , srv1080184002:87 , srv1428982802:87 , srv1597012616:87 , srv996325501:595 }
2023-05-12 22:53:27,430 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=426 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=9293 (was 10144)
2023-05-12 22:53:27,439 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=426, ProcessCount=172, AvailableMemoryMB=9293
2023-05-12 22:53:27,440 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-12 22:53:27,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-12 22:53:27,453 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1086050181:84 , srv1093902630:84 , srv109748154:84 , srv1146495614:84 , srv1227626000:84 , srv1261472519:84 , srv1386495831:84 , srv1437878188:84 , srv1438733642:84 , srv1520445367:84 , srv1636490831:84 , srv1671016049:84 , srv1725334502:84 , srv1752349970:84 , srv1982023744:84 , srv2010886896:84 , srv2024826771:84 , srv2033659797:84 , srv2086892128:84 , srv2093191943:84 , srv423487099:84 , srv463028145:84 , srv494313862:84 , srv504283202:84 , srv527630702:84 , srv528146986:84 , srv637799863:84 , srv800848252:84 , srv895942306:84 , srv1533023104:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-12 22:53:27,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:53:27,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1386495831=6, srv1533023104=10, srv1520445367=9, srv527630702=25, srv463028145=22, srv1086050181=0, srv2086892128=19, srv800848252=28, srv1982023744=15, srv637799863=27, srv528146986=26, srv2010886896=16, srv895942306=29, srv2033659797=18, srv1636490831=11, srv494313862=23, srv1227626000=4, srv1437878188=7, srv504283202=24, srv1146495614=3, srv1438733642=8, srv1752349970=14, srv1093902630=1, srv1671016049=12, srv423487099=21, srv1725334502=13, srv1261472519=5, srv2093191943=20, srv2024826771=17, srv109748154=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:53:27,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:53:27,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:53:27,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-12 22:53:27,497 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0795206757894902, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:53:27,498 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912443610317104, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0795206757894902, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-12 22:55:27,476 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6830743 different iterations.  Found a solution that moves 1859 regions; Going from a computed imbalance of 0.9912443610317104 to a new imbalance of 4.338998739279625E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6885185185185185, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:55:27,485 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1086050181:90 , srv1093902630:90 , srv109748154:90 , srv1146495614:90 , srv1227626000:90 , srv1261472519:90 , srv1386495831:90 , srv1437878188:90 , srv1438733642:90 , srv1520445367:90 , srv1533023104:90 , srv1636490831:90 , srv1671016049:90 , srv1725334502:90 , srv1752349970:90 , srv1982023744:90 , srv2010886896:90 , srv2024826771:90 , srv2033659797:90 , srv2086892128:90 , srv2093191943:90 , srv423487099:90 , srv463028145:90 , srv494313862:90 , srv504283202:90 , srv527630702:90 , srv528146986:90 , srv637799863:90 , srv800848252:90 , srv895942306:90 }
2023-05-12 22:55:27,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-12 22:55:27,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1386495831=6, srv1533023104=10, srv1520445367=9, srv527630702=25, srv463028145=22, srv1086050181=0, srv2086892128=19, srv800848252=28, srv1982023744=15, srv637799863=27, srv528146986=26, srv2010886896=16, srv895942306=29, srv2033659797=18, srv1636490831=11, srv494313862=23, srv1227626000=4, srv1437878188=7, srv504283202=24, srv1146495614=3, srv1438733642=8, srv1752349970=14, srv1093902630=1, srv1671016049=12, srv423487099=21, srv1725334502=13, srv1261472519=5, srv2093191943=20, srv2024826771=17, srv109748154=2} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-12 22:55:27,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-12 22:55:27,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-12 22:55:27,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-12 22:55:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-12 22:55:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-12 22:55:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-12 22:55:27,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-12 22:55:27,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-12 22:55:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-12 22:55:27,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-12 22:55:27,516 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-12 22:55:27,516 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1086050181:90 , srv1093902630:90 , srv109748154:90 , srv1146495614:90 , srv1227626000:90 , srv1261472519:90 , srv1386495831:90 , srv1437878188:90 , srv1438733642:90 , srv1520445367:90 , srv1533023104:90 , srv1636490831:90 , srv1671016049:90 , srv1725334502:90 , srv1752349970:90 , srv1982023744:90 , srv2010886896:90 , srv2024826771:90 , srv2033659797:90 , srv2086892128:90 , srv2093191943:90 , srv423487099:90 , srv463028145:90 , srv494313862:90 , srv504283202:90 , srv527630702:90 , srv528146986:90 , srv637799863:90 , srv800848252:90 , srv895942306:90 }
2023-05-12 22:55:27,535 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 426), ProcessCount=169 (was 172), AvailableMemoryMB=9198 (was 9293)