2023-08-23 19:53:12,256 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-23 19:53:12,576 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-23 19:53:12,691 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-23 19:53:12,760 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 19:53:12,767 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-23 19:53:12,786 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=171, AvailableMemoryMB=11703
2023-08-23 19:53:12,789 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 19:53:12,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-23 19:53:12,937 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009783417:84 , srv101457853:84 , srv1038851918:84 , srv1060167287:84 , srv1071861910:84 , srv1072083143:84 , srv1107856190:84 , srv1123074316:84 , srv1153688859:84 , srv1174847234:84 , srv1212382103:84 , srv1225092247:84 , srv1246554766:84 , srv1269693953:84 , srv1270277796:84 , srv1304763432:84 , srv1311624813:84 , srv1318330896:84 , srv133561370:84 , srv1337173:84 , srv134149847:84 , srv1345434280:84 , srv1359950000:84 , srv1368611553:84 , srv1371423975:84 , srv1430206321:84 , srv1501208585:84 , srv1509215395:84 , srv1519042218:84 , srv1598814154:84 , srv160382094:84 , srv1611387741:84 , srv1624023073:84 , srv1639664926:84 , srv1653126310:84 , srv1753348792:84 , srv1760494585:84 , srv1764813423:84 , srv1773154340:84 , srv1811780540:84 , srv1825121740:84 , srv1856251587:84 , srv1861713311:84 , srv1867250585:84 , srv187932025:84 , srv1911385950:84 , srv1922319737:84 , srv1952143107:84 , srv1966632983:84 , srv1970787976:84 , srv1977208151:84 , srv1985003219:84 , srv2007538309:84 , srv2029801443:84 , srv2047848630:84 , srv205750588:84 , srv2073792460:84 , srv2080994730:84 , srv2103764715:84 , srv2108722395:84 , srv2123321594:84 , srv2129183263:84 , srv229908113:84 , srv235146919:84 , srv273812190:84 , srv323573345:84 , srv367633951:84 , srv370003553:84 , srv371268961:84 , srv38718126:84 , srv394676394:84 , srv410545827:84 , srv460231304:84 , srv493723014:84 , srv509817147:84 , srv513287749:84 , srv522796308:84 , srv535512722:84 , srv559764961:84 , srv573611085:84 , srv614482972:84 , srv615932683:84 , srv635597538:84 , srv637211780:84 , srv646306265:84 , srv655385348:84 , srv719231107:84 , srv788542388:84 , srv792477097:84 , srv824063726:84 , srv840002533:84 , srv846560729:84 , srv853351937:84 , srv932404162:84 , srv93824213:84 , srv951224742:84 , srv957048701:84 , srv959061925:84 , srv961217008:84 , srv1908945828:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-23 19:53:12,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:12,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:13,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:13,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:13,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:13,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:13,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:13,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:13,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:13,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:13,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:13,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:13,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:13,407 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 19:53:13,407 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 19:53:13,857 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 816 ms to try 5000 different iterations.  Found a solution that moves 4687 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18252505321645474. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041390894354052764, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0587581930672247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5207777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041390894354052764, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:13,877 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1753348792:82 , srv1304763432:83 , srv1311624813:83 , srv187932025:83 , srv205750588:83 , srv394676394:83 , srv410545827:83 , srv559764961:83 , srv846560729:83 , srv93824213:83 , srv1060167287:84 , srv1123074316:84 , srv1174847234:84 , srv1624023073:84 , srv1764813423:84 , srv1922319737:84 , srv1985003219:84 , srv2047848630:84 , srv2103764715:84 , srv509817147:84 , srv522796308:84 , srv959061925:84 , srv1246554766:85 , srv1270277796:85 , srv1318330896:85 , srv1337173:85 , srv1430206321:85 , srv160382094:85 , srv1611387741:85 , srv1639664926:85 , srv1773154340:85 , srv1825121740:85 , srv1867250585:85 , srv1911385950:85 , srv2080994730:85 , srv323573345:85 , srv367633951:85 , srv370003553:85 , srv513287749:85 , srv615932683:85 , srv637211780:85 , srv655385348:85 , srv719231107:85 , srv840002533:85 , srv957048701:85 , srv1071861910:86 , srv1072083143:86 , srv1107856190:86 , srv1153688859:86 , srv1212382103:86 , srv1371423975:86 , srv1519042218:86 , srv1653126310:86 , srv1760494585:86 , srv1811780540:86 , srv1952143107:86 , srv2129183263:86 , srv235146919:86 , srv493723014:86 , srv824063726:86 , srv853351937:86 , srv932404162:86 , srv951224742:86 , srv1009783417:87 , srv1225092247:87 , srv1598814154:87 , srv1856251587:87 , srv1977208151:87 , srv229908113:87 , srv573611085:87 , srv635597538:87 , srv646306265:87 , srv101457853:88 , srv1038851918:88 , srv1269693953:88 , srv1359950000:88 , srv1368611553:88 , srv1509215395:88 , srv2007538309:88 , srv460231304:88 , srv788542388:88 , srv961217008:88 , srv1501208585:89 , srv1861713311:89 , srv1970787976:89 , srv371268961:89 , srv614482972:89 , srv133561370:90 , srv2029801443:90 , srv2108722395:90 , srv2123321594:90 , srv134149847:91 , srv273812190:91 , srv38718126:91 , srv792477097:91 , srv1345434280:92 , srv1966632983:92 , srv535512722:92 , srv2073792460:94 , srv1908945828:458 }
2023-08-23 19:53:13,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:13,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:13,907 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:13,908 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:13,909 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:13,910 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:13,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:13,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:13,913 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:13,914 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:13,915 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:13,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:13,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:13,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:13,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:13,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:13,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:14,086 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041390894354052764, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0587581930672247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041390894354052764, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:14,086 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 19:53:14,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18249223414099858, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041390894354052764, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0587581930672247, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041390894354052764, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17775, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24441666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 19:53:14,453 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 506 ms to try 5000 different iterations.  Found a solution that moves 2730 regions; Going from a computed imbalance of 0.18249223414099858 to a new imbalance of 0.0160217624894104. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150758891867937); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032038837262824624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.30333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150758891867937); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:14,465 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2073792460:79 , srv1966632983:80 , srv2029801443:80 , srv1269693953:81 , srv1345434280:81 , srv273812190:81 , srv371268961:81 , srv535512722:81 , srv792477097:81 , srv961217008:81 , srv133561370:82 , srv1970787976:82 , srv2108722395:82 , srv1501208585:83 , srv1598814154:83 , srv1977208151:83 , srv2007538309:83 , srv2123321594:83 , srv38718126:83 , srv101457853:84 , srv1038851918:84 , srv134149847:84 , srv1368611553:84 , srv1760494585:84 , srv1861713311:84 , srv573611085:84 , srv614482972:84 , srv1009783417:85 , srv1123074316:85 , srv1246554766:85 , srv1270277796:85 , srv1359950000:85 , srv1509215395:85 , srv1519042218:85 , srv1611387741:85 , srv1867250585:85 , srv229908113:85 , srv460231304:85 , srv522796308:85 , srv646306265:85 , srv788542388:85 , srv1060167287:86 , srv1107856190:86 , srv1153688859:86 , srv1212382103:86 , srv1225092247:86 , srv1304763432:86 , srv1430206321:86 , srv1639664926:86 , srv1653126310:86 , srv1773154340:86 , srv1856251587:86 , srv1911385950:86 , srv1952143107:86 , srv2047848630:86 , srv493723014:86 , srv635597538:86 , srv853351937:86 , srv1071861910:87 , srv1072083143:87 , srv1174847234:87 , srv1311624813:87 , srv1318330896:87 , srv1371423975:87 , srv160382094:87 , srv1764813423:87 , srv1811780540:87 , srv2103764715:87 , srv235146919:87 , srv323573345:87 , srv370003553:87 , srv410545827:87 , srv615932683:87 , srv655385348:87 , srv824063726:87 , srv846560729:87 , srv951224742:87 , srv957048701:87 , srv1337173:88 , srv205750588:88 , srv2129183263:88 , srv513287749:88 , srv719231107:88 , srv840002533:88 , srv932404162:88 , srv187932025:89 , srv367633951:89 , srv559764961:89 , srv637211780:89 , srv1624023073:90 , srv1825121740:90 , srv1922319737:90 , srv1985003219:90 , srv509817147:90 , srv93824213:90 , srv959061925:90 , srv394676394:91 , srv1753348792:93 , srv2080994730:93 , srv1908945828:507 }
2023-08-23 19:53:14,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:14,470 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:14,496 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:14,497 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:14,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:14,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:14,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:14,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:14,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:14,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:14,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:14,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:14,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:14,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:14,633 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150758891867937); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032038837262824624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150758891867937); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:14,634 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 19:53:14,634 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01600264662083875, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02150758891867937); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032038837262824624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02150758891867937); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 19:53:14,912 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 381 ms to try 5000 different iterations.  Found a solution that moves 1039 regions; Going from a computed imbalance of 0.01600264662083875 to a new imbalance of 3.8783514664972855E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005647941156443356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068329432425405096); MoveCostFunction : (multiplier=7.0, imbalance=0.11544444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005647941156443356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00275); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:14,914 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2080994730:80 , srv1753348792:82 , srv1825121740:82 , srv134149847:83 , srv1624023073:83 , srv1985003219:83 , srv394676394:83 , srv637211780:83 , srv932404162:83 , srv1071861910:84 , srv1072083143:84 , srv1225092247:84 , srv1371423975:84 , srv1856251587:84 , srv1861713311:84 , srv1922319737:84 , srv2073792460:84 , srv2129183263:84 , srv367633951:84 , srv370003553:84 , srv38718126:84 , srv460231304:84 , srv509817147:84 , srv513287749:84 , srv614482972:84 , srv824063726:84 , srv951224742:84 , srv959061925:84 , srv1009783417:85 , srv1107856190:85 , srv1212382103:85 , srv1345434280:85 , srv1359950000:85 , srv1509215395:85 , srv1811780540:85 , srv187932025:85 , srv1966632983:85 , srv2123321594:85 , srv229908113:85 , srv273812190:85 , srv535512722:85 , srv635597538:85 , srv719231107:85 , srv788542388:85 , srv792477097:85 , srv840002533:85 , srv853351937:85 , srv93824213:85 , srv957048701:85 , srv101457853:86 , srv1038851918:86 , srv1153688859:86 , srv1174847234:86 , srv1318330896:86 , srv133561370:86 , srv1337173:86 , srv1368611553:86 , srv1430206321:86 , srv1501208585:86 , srv1519042218:86 , srv160382094:86 , srv1639664926:86 , srv1653126310:86 , srv1773154340:86 , srv1911385950:86 , srv1952143107:86 , srv2103764715:86 , srv2108722395:86 , srv235146919:86 , srv323573345:86 , srv493723014:86 , srv559764961:86 , srv573611085:86 , srv615932683:86 , srv646306265:86 , srv655385348:86 , srv1060167287:87 , srv1270277796:87 , srv1311624813:87 , srv1598814154:87 , srv1760494585:87 , srv1764813423:87 , srv1867250585:87 , srv1970787976:87 , srv2007538309:87 , srv2029801443:87 , srv205750588:87 , srv410545827:87 , srv522796308:87 , srv1123074316:88 , srv1246554766:88 , srv1269693953:88 , srv1611387741:88 , srv1977208151:88 , srv2047848630:88 , srv371268961:88 , srv846560729:88 , srv961217008:88 , srv1304763432:89 , srv1908945828:543 }
2023-08-23 19:53:14,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:14,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:14,930 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:14,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:14,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:14,933 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:14,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:14,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:14,936 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:14,937 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:14,938 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:14,939 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:14,940 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:15,101 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005647941156443356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068329432425405096); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005647941156443356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00275); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:15,102 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 19:53:15,102 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.8055991315304503E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005647941156443356); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0068329432425405096); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005647941156443356); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333333E-5); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00275); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 19:53:15,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 635 ms to try 5000 different iterations.  Found a solution that moves 235 regions; Going from a computed imbalance of 3.8055991315304503E-4 to a new imbalance of 2.7594743240744944E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.026111111111111113, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:15,589 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1337173:83 , srv1764813423:83 , srv1977208151:83 , srv235146919:83 , srv101457853:84 , srv1153688859:84 , srv1246554766:84 , srv1269693953:84 , srv1304763432:84 , srv1318330896:84 , srv133561370:84 , srv134149847:84 , srv1345434280:84 , srv1359950000:84 , srv1368611553:84 , srv1501208585:84 , srv1509215395:84 , srv160382094:84 , srv1611387741:84 , srv1639664926:84 , srv1653126310:84 , srv1811780540:84 , srv1856251587:84 , srv1911385950:84 , srv1922319737:84 , srv1970787976:84 , srv2007538309:84 , srv2047848630:84 , srv205750588:84 , srv2073792460:84 , srv2080994730:84 , srv2108722395:84 , srv2123321594:84 , srv2129183263:84 , srv323573345:84 , srv367633951:84 , srv371268961:84 , srv38718126:84 , srv493723014:84 , srv509817147:84 , srv535512722:84 , srv615932683:84 , srv635597538:84 , srv646306265:84 , srv719231107:84 , srv788542388:84 , srv840002533:84 , srv846560729:84 , srv93824213:84 , srv961217008:84 , srv1009783417:85 , srv1038851918:85 , srv1060167287:85 , srv1071861910:85 , srv1072083143:85 , srv1123074316:85 , srv1174847234:85 , srv1225092247:85 , srv1270277796:85 , srv1311624813:85 , srv1371423975:85 , srv1430206321:85 , srv1519042218:85 , srv1598814154:85 , srv1624023073:85 , srv1753348792:85 , srv1760494585:85 , srv1773154340:85 , srv1825121740:85 , srv1861713311:85 , srv1867250585:85 , srv187932025:85 , srv1952143107:85 , srv1966632983:85 , srv1985003219:85 , srv2029801443:85 , srv2103764715:85 , srv229908113:85 , srv273812190:85 , srv394676394:85 , srv410545827:85 , srv460231304:85 , srv513287749:85 , srv559764961:85 , srv573611085:85 , srv614482972:85 , srv637211780:85 , srv655385348:85 , srv792477097:85 , srv824063726:85 , srv853351937:85 , srv932404162:85 , srv951224742:85 , srv957048701:85 , srv959061925:85 , srv1107856190:86 , srv1212382103:86 , srv522796308:86 , srv370003553:87 , srv1908945828:634 }
2023-08-23 19:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:15,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:15,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:15,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:15,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:15,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:15,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:15,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:15,610 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:15,611 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:15,733 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:15,733 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-23 19:53:15,734 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5949238070657733E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-23 19:53:16,009 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 387 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 2.5949238070657733E-5 to a new imbalance of 6.940129244310425E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:16,009 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038851918:83 , srv1107856190:83 , srv1212382103:83 , srv1952143107:83 , srv370003553:83 , srv559764961:83 , srv655385348:83 , srv959061925:83 , srv1009783417:84 , srv101457853:84 , srv1060167287:84 , srv1071861910:84 , srv1072083143:84 , srv1123074316:84 , srv1153688859:84 , srv1174847234:84 , srv1225092247:84 , srv1246554766:84 , srv1270277796:84 , srv1304763432:84 , srv1311624813:84 , srv1318330896:84 , srv133561370:84 , srv1337173:84 , srv134149847:84 , srv1345434280:84 , srv1359950000:84 , srv1368611553:84 , srv1371423975:84 , srv1430206321:84 , srv1501208585:84 , srv1509215395:84 , srv1519042218:84 , srv1598814154:84 , srv160382094:84 , srv1611387741:84 , srv1624023073:84 , srv1653126310:84 , srv1753348792:84 , srv1760494585:84 , srv1773154340:84 , srv1811780540:84 , srv1825121740:84 , srv1861713311:84 , srv1867250585:84 , srv187932025:84 , srv1922319737:84 , srv1966632983:84 , srv1970787976:84 , srv1985003219:84 , srv2007538309:84 , srv2029801443:84 , srv2047848630:84 , srv205750588:84 , srv2080994730:84 , srv2103764715:84 , srv2108722395:84 , srv2123321594:84 , srv2129183263:84 , srv229908113:84 , srv235146919:84 , srv273812190:84 , srv323573345:84 , srv367633951:84 , srv371268961:84 , srv38718126:84 , srv394676394:84 , srv410545827:84 , srv460231304:84 , srv493723014:84 , srv509817147:84 , srv513287749:84 , srv522796308:84 , srv535512722:84 , srv573611085:84 , srv614482972:84 , srv615932683:84 , srv635597538:84 , srv637211780:84 , srv646306265:84 , srv719231107:84 , srv788542388:84 , srv792477097:84 , srv824063726:84 , srv840002533:84 , srv846560729:84 , srv853351937:84 , srv932404162:84 , srv93824213:84 , srv951224742:84 , srv957048701:84 , srv1269693953:85 , srv1639664926:85 , srv1764813423:85 , srv1856251587:85 , srv1911385950:85 , srv1977208151:85 , srv2073792460:85 , srv961217008:85 , srv1908945828:684 }
2023-08-23 19:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:16,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1952143107=48, srv1345434280=21, srv1966632983=49, srv792477097=89, srv1760494585=36, srv1359950000=22, srv1123074316=7, srv1753348792=35, srv655385348=86, srv1225092247=11, srv1212382103=10, srv957048701=97, srv101457853=1, srv1519042218=28, srv509817147=75, srv235146919=64, srv615932683=82, srv2029801443=54, srv1368611553=23, srv1624023073=32, srv573611085=80, srv1977208151=51, srv513287749=76, srv635597538=83, srv493723014=74, srv2073792460=57, srv1269693953=13, srv410545827=72, srv1867250585=43, srv559764961=79, srv1908945828=45, srv1970787976=50, srv2129183263=62, srv614482972=81, srv1985003219=52, srv1107856190=6, srv1501208585=26, srv160382094=30, srv1653126310=34, srv1337173=19, srv273812190=65, srv522796308=77, srv788542388=88, srv646306265=85, srv1153688859=8, srv840002533=91, srv2007538309=53, srv229908113=63, srv535512722=78, srv1922319737=47, srv134149847=20, srv1009783417=0, srv187932025=44, srv961217008=99, srv846560729=92, srv205750588=56, srv1773154340=38, srv394676394=71, srv1430206321=25, srv2123321594=61, srv959061925=98, srv1071861910=4, srv1825121740=40, srv38718126=70, srv1509215395=27, srv323573345=66, srv951224742=96, srv2103764715=59, srv1861713311=42, srv1911385950=46, srv1318330896=17, srv1764813423=37, srv1811780540=39, srv1639664926=33, srv637211780=84, srv824063726=90, srv932404162=94, srv133561370=18, srv1304763432=15, srv2047848630=55, srv1038851918=2, srv1856251587=41, srv371268961=69, srv93824213=95, srv853351937=93, srv2080994730=58, srv1174847234=9, srv370003553=68, srv1072083143=5, srv1311624813=16, srv1371423975=24, srv1246554766=12, srv2108722395=60, srv1060167287=3, srv460231304=73, srv719231107=87, srv1598814154=29, srv1270277796=14, srv1611387741=31, srv367633951=67} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:16,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:16,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:16,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-23 19:53:16,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-23 19:53:16,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-23 19:53:16,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-23 19:53:16,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-23 19:53:16,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-23 19:53:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-23 19:53:16,178 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:16,179 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1038851918:83 , srv1107856190:83 , srv1212382103:83 , srv1952143107:83 , srv370003553:83 , srv559764961:83 , srv655385348:83 , srv959061925:83 , srv1009783417:84 , srv101457853:84 , srv1060167287:84 , srv1071861910:84 , srv1072083143:84 , srv1123074316:84 , srv1153688859:84 , srv1174847234:84 , srv1225092247:84 , srv1246554766:84 , srv1270277796:84 , srv1304763432:84 , srv1311624813:84 , srv1318330896:84 , srv133561370:84 , srv1337173:84 , srv134149847:84 , srv1345434280:84 , srv1359950000:84 , srv1368611553:84 , srv1371423975:84 , srv1430206321:84 , srv1501208585:84 , srv1509215395:84 , srv1519042218:84 , srv1598814154:84 , srv160382094:84 , srv1611387741:84 , srv1624023073:84 , srv1653126310:84 , srv1753348792:84 , srv1760494585:84 , srv1773154340:84 , srv1811780540:84 , srv1825121740:84 , srv1861713311:84 , srv1867250585:84 , srv187932025:84 , srv1922319737:84 , srv1966632983:84 , srv1970787976:84 , srv1985003219:84 , srv2007538309:84 , srv2029801443:84 , srv2047848630:84 , srv205750588:84 , srv2080994730:84 , srv2103764715:84 , srv2108722395:84 , srv2123321594:84 , srv2129183263:84 , srv229908113:84 , srv235146919:84 , srv273812190:84 , srv323573345:84 , srv367633951:84 , srv371268961:84 , srv38718126:84 , srv394676394:84 , srv410545827:84 , srv460231304:84 , srv493723014:84 , srv509817147:84 , srv513287749:84 , srv522796308:84 , srv535512722:84 , srv573611085:84 , srv614482972:84 , srv615932683:84 , srv635597538:84 , srv637211780:84 , srv646306265:84 , srv719231107:84 , srv788542388:84 , srv792477097:84 , srv824063726:84 , srv840002533:84 , srv846560729:84 , srv853351937:84 , srv932404162:84 , srv93824213:84 , srv951224742:84 , srv957048701:84 , srv1269693953:85 , srv1639664926:85 , srv1764813423:85 , srv1856251587:85 , srv1911385950:85 , srv1977208151:85 , srv2073792460:85 , srv961217008:85 , srv1908945828:684 }
2023-08-23 19:53:16,213 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 279), ProcessCount=171 (was 171), AvailableMemoryMB=10845 (was 11703)
2023-08-23 19:53:16,225 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=171, AvailableMemoryMB=10845
2023-08-23 19:53:16,226 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-23 19:53:16,226 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-23 19:53:16,239 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1154634668:84 , srv1199491852:84 , srv1284736505:84 , srv1315124963:84 , srv1447323717:84 , srv1472538104:84 , srv1609479325:84 , srv1763876224:84 , srv1786468407:84 , srv1803827068:84 , srv1986725007:84 , srv1988344959:84 , srv1990743419:84 , srv2145514181:84 , srv290504032:84 , srv347203139:84 , srv51107661:84 , srv637214440:84 , srv658939651:84 , srv659257501:84 , srv670775102:84 , srv677201976:84 , srv689658540:84 , srv76884509:84 , srv820161534:84 , srv850688277:84 , srv851653180:84 , srv931708574:84 , srv959186572:84 , srv1271352638:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-23 19:53:16,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:53:16,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv347203139=16, srv658939651=19, srv670775102=21, srv659257501=20, srv820161534=25, srv689658540=23, srv76884509=24, srv51107661=17, srv850688277=26, srv1154634668=0, srv1990743419=13, srv677201976=22, srv1472538104=6, srv851653180=27, srv1803827068=10, srv637214440=18, srv1988344959=12, srv1284736505=3, srv1786468407=9, srv1199491852=1, srv1763876224=8, srv1986725007=11, srv1447323717=5, srv1315124963=4, srv959186572=29, srv290504032=15, srv931708574=28, srv1271352638=2, srv1609479325=7, srv2145514181=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:53:16,253 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:53:16,254 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:53:16,255 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-23 19:53:16,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1822144901628027, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:53:16,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991276719517293, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1822144901628027, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-23 19:55:16,260 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5514082 different iterations.  Found a solution that moves 1866 regions; Going from a computed imbalance of 0.991276719517293 to a new imbalance of 4.3553370884861656E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6911111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:55:16,268 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1154634668:90 , srv1199491852:90 , srv1271352638:90 , srv1284736505:90 , srv1315124963:90 , srv1447323717:90 , srv1472538104:90 , srv1609479325:90 , srv1763876224:90 , srv1786468407:90 , srv1803827068:90 , srv1986725007:90 , srv1988344959:90 , srv1990743419:90 , srv2145514181:90 , srv290504032:90 , srv347203139:90 , srv51107661:90 , srv637214440:90 , srv658939651:90 , srv659257501:90 , srv670775102:90 , srv677201976:90 , srv689658540:90 , srv76884509:90 , srv820161534:90 , srv850688277:90 , srv851653180:90 , srv931708574:90 , srv959186572:90 }
2023-08-23 19:55:16,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-23 19:55:16,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv347203139=16, srv658939651=19, srv670775102=21, srv659257501=20, srv820161534=25, srv689658540=23, srv76884509=24, srv51107661=17, srv850688277=26, srv1154634668=0, srv1990743419=13, srv677201976=22, srv1472538104=6, srv851653180=27, srv1803827068=10, srv637214440=18, srv1988344959=12, srv1284736505=3, srv1786468407=9, srv1199491852=1, srv1763876224=8, srv1986725007=11, srv1447323717=5, srv1315124963=4, srv959186572=29, srv290504032=15, srv931708574=28, srv1271352638=2, srv1609479325=7, srv2145514181=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-23 19:55:16,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-23 19:55:16,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-23 19:55:16,287 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-23 19:55:16,288 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1154634668:90 , srv1199491852:90 , srv1271352638:90 , srv1284736505:90 , srv1315124963:90 , srv1447323717:90 , srv1472538104:90 , srv1609479325:90 , srv1763876224:90 , srv1786468407:90 , srv1803827068:90 , srv1986725007:90 , srv1988344959:90 , srv1990743419:90 , srv2145514181:90 , srv290504032:90 , srv347203139:90 , srv51107661:90 , srv637214440:90 , srv658939651:90 , srv659257501:90 , srv670775102:90 , srv677201976:90 , srv689658540:90 , srv76884509:90 , srv820161534:90 , srv850688277:90 , srv851653180:90 , srv931708574:90 , srv959186572:90 }
2023-08-23 19:55:16,308 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 279), ProcessCount=169 (was 171), AvailableMemoryMB=10922 (was 10845) - AvailableMemoryMB LEAK? -