2023-11-15 06:55:16,855 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-15 06:55:17,148 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-15 06:55:17,246 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-15 06:55:17,305 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 06:55:17,312 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-15 06:55:17,325 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=117, ProcessCount=173, AvailableMemoryMB=1713
2023-11-15 06:55:17,326 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 06:55:17,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-15 06:55:17,442 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1012335422:84 , srv1087216698:84 , srv1093821896:84 , srv1115534694:84 , srv1138417357:84 , srv1146369582:84 , srv1166951839:84 , srv1175956773:84 , srv126327811:84 , srv1275537243:84 , srv1283098034:84 , srv130196851:84 , srv1347935816:84 , srv1450970159:84 , srv1451635982:84 , srv1461505214:84 , srv1485579332:84 , srv1515639710:84 , srv1516266023:84 , srv1546344392:84 , srv1568632150:84 , srv1572756490:84 , srv1577074087:84 , srv1598104430:84 , srv1627496141:84 , srv1637927050:84 , srv1667382494:84 , srv1670386142:84 , srv1672851018:84 , srv1681532658:84 , srv1715275090:84 , srv1724239179:84 , srv1731666145:84 , srv1736217252:84 , srv1738383639:84 , srv1756076120:84 , srv1761111341:84 , srv1767582681:84 , srv1789218083:84 , srv1801384282:84 , srv1803677860:84 , srv1819167859:84 , srv1862685362:84 , srv1865675279:84 , srv1873157147:84 , srv1896435213:84 , srv1901192824:84 , srv201145771:84 , srv2030084194:84 , srv2064636135:84 , srv2074972336:84 , srv2077812505:84 , srv2090038732:84 , srv2095406610:84 , srv2098627444:84 , srv2109048180:84 , srv2109088140:84 , srv2112948489:84 , srv2140243764:84 , srv219922161:84 , srv226973005:84 , srv23311827:84 , srv237026614:84 , srv290275468:84 , srv290527530:84 , srv308626153:84 , srv323082528:84 , srv349987646:84 , srv365890865:84 , srv396579846:84 , srv400456050:84 , srv41785403:84 , srv44584348:84 , srv454192386:84 , srv50538193:84 , srv508165966:84 , srv509542227:84 , srv531799805:84 , srv539468883:84 , srv542513519:84 , srv556577866:84 , srv589522448:84 , srv591240803:84 , srv593185508:84 , srv634866499:84 , srv649382558:84 , srv652010045:84 , srv654019930:84 , srv678017143:84 , srv710343673:84 , srv723277259:84 , srv751091575:84 , srv775817664:84 , srv83032282:84 , srv853714894:84 , srv888638829:84 , srv902394281:84 , srv957880577:84 , srv966942579:84 , srv48182684:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-15 06:55:17,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:17,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2074972336=50, srv454192386=73, srv1819167859=41, srv1767582681=37, srv1761111341=36, srv1627496141=24, srv1667382494=26, srv1515639710=17, srv539468883=79, srv1901192824=46, srv853714894=95, srv2098627444=54, srv41785403=71, srv23311827=61, srv634866499=85, srv710343673=90, srv902394281=97, srv1672851018=28, srv2095406610=53, srv1138417357=4, srv1731666145=32, srv201145771=47, srv751091575=92, srv219922161=59, srv1577074087=22, srv775817664=93, srv2140243764=58, srv226973005=60, srv1736217252=33, srv542513519=80, srv2109048180=55, srv723277259=91, srv1738383639=34, srv323082528=66, srv1715275090=30, srv957880577=98, srv1461505214=15, srv556577866=81, srv2112948489=57, srv593185508=84, srv1670386142=27, srv1873157147=44, srv1012335422=0, srv1568632150=20, srv1803677860=40, srv400456050=70, srv654019930=88, srv509542227=77, srv888638829=96, srv48182684=74, srv1862685362=42, srv1865675279=43, srv83032282=94, srv1896435213=45, srv1681532658=29, srv1115534694=3, srv237026614=62, srv1789218083=38, srv2109088140=56, srv1801384282=39, srv396579846=69, srv1146369582=5, srv1756076120=35, srv591240803=83, srv2064636135=49, srv1087216698=1, srv349987646=67, srv589522448=82, srv1450970159=13, srv290527530=64, srv508165966=76, srv1093821896=2, srv1598104430=23, srv2090038732=52, srv130196851=11, srv1724239179=31, srv1451635982=14, srv290275468=63, srv44584348=72, srv652010045=87, srv1347935816=12, srv649382558=86, srv308626153=65, srv1516266023=18, srv1275537243=9, srv1637927050=25, srv50538193=75, srv2030084194=48, srv1166951839=6, srv1283098034=10, srv966942579=99, srv1485579332=16, srv2077812505=51, srv531799805=78, srv1175956773=7, srv1546344392=19, srv365890865=68, srv678017143=89, srv126327811=8, srv1572756490=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:17,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:17,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:17,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 06:55:17,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 06:55:17,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 06:55:17,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 06:55:17,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 06:55:17,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 06:55:17,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 06:55:17,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 06:55:17,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 06:55:17,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 06:55:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 06:55:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 06:55:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 06:55:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 06:55:17,551 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 06:55:17,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 06:55:17,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 06:55:17,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 06:55:17,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 06:55:17,552 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 06:55:17,840 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:17,841 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 06:55:17,841 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 06:55:18,522 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 946 ms to try 5000 different iterations.  Found a solution that moves 4688 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18156401709706566. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040855363702148303, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055831637242442715, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5208888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040855363702148303, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:18,538 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1146369582:82 , srv1283098034:82 , srv1627496141:82 , srv1681532658:82 , srv1761111341:82 , srv2064636135:82 , srv290275468:82 , srv652010045:82 , srv853714894:82 , srv888638829:82 , srv1093821896:83 , srv1450970159:83 , srv1731666145:83 , srv542513519:83 , srv966942579:83 , srv130196851:84 , srv1568632150:84 , srv1577074087:84 , srv1736217252:84 , srv323082528:84 , srv508165966:84 , srv591240803:84 , srv654019930:84 , srv678017143:84 , srv775817664:84 , srv1012335422:85 , srv1166951839:85 , srv1275537243:85 , srv1572756490:85 , srv1667382494:85 , srv1803677860:85 , srv1819167859:85 , srv1873157147:85 , srv219922161:85 , srv649382558:85 , srv723277259:85 , srv751091575:85 , srv902394281:85 , srv1138417357:86 , srv126327811:86 , srv1347935816:86 , srv1451635982:86 , srv1516266023:86 , srv1546344392:86 , srv1865675279:86 , srv50538193:86 , srv509542227:86 , srv1087216698:87 , srv1115534694:87 , srv1461505214:87 , srv1485579332:87 , srv1715275090:87 , srv1724239179:87 , srv1738383639:87 , srv1767582681:87 , srv1896435213:87 , srv201145771:87 , srv2077812505:87 , srv2095406610:87 , srv2098627444:87 , srv2109088140:87 , srv2140243764:87 , srv23311827:87 , srv349987646:87 , srv365890865:87 , srv396579846:87 , srv41785403:87 , srv454192386:87 , srv539468883:87 , srv593185508:87 , srv1175956773:88 , srv1515639710:88 , srv1672851018:88 , srv1756076120:88 , srv1789218083:88 , srv1801384282:88 , srv2030084194:88 , srv2074972336:88 , srv2109048180:88 , srv226973005:88 , srv237026614:88 , srv290527530:88 , srv308626153:88 , srv83032282:88 , srv957880577:88 , srv1598104430:89 , srv1637927050:89 , srv1670386142:89 , srv1862685362:89 , srv2090038732:89 , srv531799805:89 , srv589522448:89 , srv44584348:90 , srv400456050:91 , srv634866499:91 , srv710343673:91 , srv1901192824:94 , srv2112948489:95 , srv556577866:97 , srv48182684:453 }
2023-11-15 06:55:18,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:18,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2074972336=50, srv454192386=73, srv1819167859=41, srv1767582681=37, srv1761111341=36, srv1627496141=24, srv1667382494=26, srv1515639710=17, srv539468883=79, srv1901192824=46, srv853714894=95, srv2098627444=54, srv41785403=71, srv23311827=61, srv634866499=85, srv710343673=90, srv902394281=97, srv1672851018=28, srv2095406610=53, srv1138417357=4, srv1731666145=32, srv201145771=47, srv751091575=92, srv219922161=59, srv1577074087=22, srv775817664=93, srv2140243764=58, srv226973005=60, srv1736217252=33, srv542513519=80, srv2109048180=55, srv723277259=91, srv1738383639=34, srv323082528=66, srv1715275090=30, srv957880577=98, srv1461505214=15, srv556577866=81, srv2112948489=57, srv593185508=84, srv1670386142=27, srv1873157147=44, srv1012335422=0, srv1568632150=20, srv1803677860=40, srv400456050=70, srv654019930=88, srv509542227=77, srv888638829=96, srv48182684=74, srv1862685362=42, srv1865675279=43, srv83032282=94, srv1896435213=45, srv1681532658=29, srv1115534694=3, srv237026614=62, srv1789218083=38, srv2109088140=56, srv1801384282=39, srv396579846=69, srv1146369582=5, srv1756076120=35, srv591240803=83, srv2064636135=49, srv1087216698=1, srv349987646=67, srv589522448=82, srv1450970159=13, srv290527530=64, srv508165966=76, srv1093821896=2, srv1598104430=23, srv2090038732=52, srv130196851=11, srv1724239179=31, srv1451635982=14, srv290275468=63, srv44584348=72, srv652010045=87, srv1347935816=12, srv649382558=86, srv308626153=65, srv1516266023=18, srv1275537243=9, srv1637927050=25, srv50538193=75, srv2030084194=48, srv1166951839=6, srv1283098034=10, srv966942579=99, srv1485579332=16, srv2077812505=51, srv531799805=78, srv1175956773=7, srv1546344392=19, srv365890865=68, srv678017143=89, srv126327811=8, srv1572756490=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:18,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:18,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:18,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:18,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 06:55:18,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 06:55:18,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 06:55:18,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 06:55:18,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 06:55:18,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 06:55:18,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 06:55:18,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 06:55:18,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 06:55:18,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 06:55:18,749 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040855363702148303, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055831637242442715, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040855363702148303, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:18,749 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 06:55:18,750 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18153119101945983, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040855363702148303, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.055831637242442715, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040855363702148303, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 06:55:18,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 2727 regions; Going from a computed imbalance of 0.18153119101945983 to a new imbalance of 0.01432847616328779. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023404572986126568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030510067150546626, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.303, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023404572986126568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:18,992 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv556577866:77 , srv2112948489:78 , srv1901192824:79 , srv1862685362:80 , srv710343673:80 , srv1670386142:81 , srv44584348:81 , srv1637927050:82 , srv1756076120:82 , srv2030084194:82 , srv400456050:82 , srv531799805:82 , srv1115534694:83 , srv1738383639:83 , srv1789218083:83 , srv1801384282:83 , srv2074972336:83 , srv2090038732:83 , srv237026614:83 , srv349987646:83 , srv593185508:83 , srv83032282:83 , srv1087216698:84 , srv1175956773:84 , srv1485579332:84 , srv1515639710:84 , srv1598104430:84 , srv1896435213:84 , srv201145771:84 , srv2095406610:84 , srv226973005:84 , srv365890865:84 , srv41785403:84 , srv509542227:84 , srv634866499:84 , srv1461505214:85 , srv1667382494:85 , srv1767582681:85 , srv1803677860:85 , srv1873157147:85 , srv2109048180:85 , srv2109088140:85 , srv23311827:85 , srv396579846:85 , srv50538193:85 , srv539468883:85 , srv589522448:85 , srv723277259:85 , srv1012335422:86 , srv1347935816:86 , srv1451635982:86 , srv1516266023:86 , srv1546344392:86 , srv1724239179:86 , srv1819167859:86 , srv1865675279:86 , srv2098627444:86 , srv219922161:86 , srv308626153:86 , srv323082528:86 , srv751091575:86 , srv957880577:86 , srv1166951839:87 , srv1275537243:87 , srv1577074087:87 , srv1672851018:87 , srv1681532658:87 , srv1715275090:87 , srv2077812505:87 , srv454192386:87 , srv508165966:87 , srv591240803:87 , srv649382558:87 , srv902394281:87 , srv966942579:87 , srv1093821896:88 , srv130196851:88 , srv1568632150:88 , srv1572756490:88 , srv2140243764:88 , srv290527530:88 , srv542513519:88 , srv654019930:88 , srv775817664:88 , srv1138417357:89 , srv126327811:89 , srv1283098034:89 , srv1450970159:89 , srv1731666145:89 , srv1736217252:89 , srv2064636135:89 , srv290275468:89 , srv678017143:90 , srv853714894:90 , srv888638829:90 , srv1146369582:92 , srv1627496141:92 , srv652010045:92 , srv1761111341:93 , srv48182684:529 }
2023-11-15 06:55:18,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:19,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2074972336=50, srv454192386=73, srv1819167859=41, srv1767582681=37, srv1761111341=36, srv1627496141=24, srv1667382494=26, srv1515639710=17, srv539468883=79, srv1901192824=46, srv853714894=95, srv2098627444=54, srv41785403=71, srv23311827=61, srv634866499=85, srv710343673=90, srv902394281=97, srv1672851018=28, srv2095406610=53, srv1138417357=4, srv1731666145=32, srv201145771=47, srv751091575=92, srv219922161=59, srv1577074087=22, srv775817664=93, srv2140243764=58, srv226973005=60, srv1736217252=33, srv542513519=80, srv2109048180=55, srv723277259=91, srv1738383639=34, srv323082528=66, srv1715275090=30, srv957880577=98, srv1461505214=15, srv556577866=81, srv2112948489=57, srv593185508=84, srv1670386142=27, srv1873157147=44, srv1012335422=0, srv1568632150=20, srv1803677860=40, srv400456050=70, srv654019930=88, srv509542227=77, srv888638829=96, srv48182684=74, srv1862685362=42, srv1865675279=43, srv83032282=94, srv1896435213=45, srv1681532658=29, srv1115534694=3, srv237026614=62, srv1789218083=38, srv2109088140=56, srv1801384282=39, srv396579846=69, srv1146369582=5, srv1756076120=35, srv591240803=83, srv2064636135=49, srv1087216698=1, srv349987646=67, srv589522448=82, srv1450970159=13, srv290527530=64, srv508165966=76, srv1093821896=2, srv1598104430=23, srv2090038732=52, srv130196851=11, srv1724239179=31, srv1451635982=14, srv290275468=63, srv44584348=72, srv652010045=87, srv1347935816=12, srv649382558=86, srv308626153=65, srv1516266023=18, srv1275537243=9, srv1637927050=25, srv50538193=75, srv2030084194=48, srv1166951839=6, srv1283098034=10, srv966942579=99, srv1485579332=16, srv2077812505=51, srv531799805=78, srv1175956773=7, srv1546344392=19, srv365890865=68, srv678017143=89, srv126327811=8, srv1572756490=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:19,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:19,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 06:55:19,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 06:55:19,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 06:55:19,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 06:55:19,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 06:55:19,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 06:55:19,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 06:55:19,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 06:55:19,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023404572986126568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030510067150546626, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023404572986126568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:19,165 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 06:55:19,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014309381301165118, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023404572986126568); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030510067150546626, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023404572986126568); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011166666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 06:55:19,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 338 ms to try 5000 different iterations.  Found a solution that moves 966 regions; Going from a computed imbalance of 0.014309381301165118 to a new imbalance of 7.566679524828728E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006733670025252104); MoveCostFunction : (multiplier=7.0, imbalance=0.10733333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:19,392 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1138417357:82 , srv126327811:82 , srv290527530:82 , srv652010045:82 , srv1146369582:83 , srv1672851018:83 , srv1715275090:83 , srv1761111341:83 , srv2140243764:83 , srv589522448:83 , srv634866499:83 , srv1724239179:84 , srv1736217252:84 , srv1901192824:84 , srv2077812505:84 , srv2109048180:84 , srv454192386:84 , srv556577866:84 , srv678017143:84 , srv775817664:84 , srv957880577:84 , srv1166951839:85 , srv1175956773:85 , srv1275537243:85 , srv1347935816:85 , srv1515639710:85 , srv1516266023:85 , srv1572756490:85 , srv1598104430:85 , srv1627496141:85 , srv1767582681:85 , srv2090038732:85 , srv2098627444:85 , srv2109088140:85 , srv226973005:85 , srv308626153:85 , srv396579846:85 , srv400456050:85 , srv649382558:85 , srv853714894:85 , srv888638829:85 , srv902394281:85 , srv1087216698:86 , srv1093821896:86 , srv1283098034:86 , srv130196851:86 , srv1450970159:86 , srv1451635982:86 , srv1546344392:86 , srv1568632150:86 , srv1637927050:86 , srv1731666145:86 , srv1819167859:86 , srv1865675279:86 , srv1873157147:86 , srv1896435213:86 , srv2064636135:86 , srv2074972336:86 , srv2095406610:86 , srv2112948489:86 , srv23311827:86 , srv237026614:86 , srv41785403:86 , srv50538193:86 , srv508165966:86 , srv531799805:86 , srv539468883:86 , srv542513519:86 , srv654019930:86 , srv710343673:86 , srv751091575:86 , srv1012335422:87 , srv1115534694:87 , srv1461505214:87 , srv1485579332:87 , srv1577074087:87 , srv1670386142:87 , srv1738383639:87 , srv1756076120:87 , srv1789218083:87 , srv1801384282:87 , srv201145771:87 , srv2030084194:87 , srv219922161:87 , srv290275468:87 , srv323082528:87 , srv349987646:87 , srv365890865:87 , srv44584348:87 , srv509542227:87 , srv591240803:87 , srv723277259:87 , srv83032282:87 , srv1667382494:88 , srv1681532658:88 , srv1803677860:88 , srv1862685362:88 , srv593185508:88 , srv966942579:88 , srv48182684:530 }
2023-11-15 06:55:19,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:19,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2074972336=50, srv454192386=73, srv1819167859=41, srv1767582681=37, srv1761111341=36, srv1627496141=24, srv1667382494=26, srv1515639710=17, srv539468883=79, srv1901192824=46, srv853714894=95, srv2098627444=54, srv41785403=71, srv23311827=61, srv634866499=85, srv710343673=90, srv902394281=97, srv1672851018=28, srv2095406610=53, srv1138417357=4, srv1731666145=32, srv201145771=47, srv751091575=92, srv219922161=59, srv1577074087=22, srv775817664=93, srv2140243764=58, srv226973005=60, srv1736217252=33, srv542513519=80, srv2109048180=55, srv723277259=91, srv1738383639=34, srv323082528=66, srv1715275090=30, srv957880577=98, srv1461505214=15, srv556577866=81, srv2112948489=57, srv593185508=84, srv1670386142=27, srv1873157147=44, srv1012335422=0, srv1568632150=20, srv1803677860=40, srv400456050=70, srv654019930=88, srv509542227=77, srv888638829=96, srv48182684=74, srv1862685362=42, srv1865675279=43, srv83032282=94, srv1896435213=45, srv1681532658=29, srv1115534694=3, srv237026614=62, srv1789218083=38, srv2109088140=56, srv1801384282=39, srv396579846=69, srv1146369582=5, srv1756076120=35, srv591240803=83, srv2064636135=49, srv1087216698=1, srv349987646=67, srv589522448=82, srv1450970159=13, srv290527530=64, srv508165966=76, srv1093821896=2, srv1598104430=23, srv2090038732=52, srv130196851=11, srv1724239179=31, srv1451635982=14, srv290275468=63, srv44584348=72, srv652010045=87, srv1347935816=12, srv649382558=86, srv308626153=65, srv1516266023=18, srv1275537243=9, srv1637927050=25, srv50538193=75, srv2030084194=48, srv1166951839=6, srv1283098034=10, srv966942579=99, srv1485579332=16, srv2077812505=51, srv531799805=78, srv1175956773=7, srv1546344392=19, srv365890865=68, srv678017143=89, srv126327811=8, srv1572756490=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:19,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:19,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:19,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:19,419 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:19,420 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 06:55:19,421 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 06:55:19,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 06:55:19,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 06:55:19,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 06:55:19,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 06:55:19,422 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 06:55:19,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 06:55:19,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 06:55:19,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 06:55:19,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 06:55:19,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 06:55:19,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 06:55:19,542 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006733670025252104); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:19,542 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-15 06:55:19,542 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.499038759113654E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00610013298189536); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006733670025252104); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00610013298189536); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-15 06:55:19,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 439 ms to try 5000 different iterations.  Found a solution that moves 246 regions; Going from a computed imbalance of 7.499038759113654E-4 to a new imbalance of 1.2783136093630353E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.027333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:19,881 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1461505214:83 , srv1577074087:83 , srv1627496141:83 , srv2098627444:83 , srv308626153:83 , srv1012335422:84 , srv1175956773:84 , srv130196851:84 , srv1450970159:84 , srv1451635982:84 , srv1485579332:84 , srv1546344392:84 , srv1568632150:84 , srv1598104430:84 , srv1637927050:84 , srv1667382494:84 , srv1672851018:84 , srv1731666145:84 , srv1761111341:84 , srv1789218083:84 , srv1801384282:84 , srv1803677860:84 , srv1862685362:84 , srv1865675279:84 , srv201145771:84 , srv2074972336:84 , srv2077812505:84 , srv2112948489:84 , srv2140243764:84 , srv219922161:84 , srv23311827:84 , srv290275468:84 , srv290527530:84 , srv365890865:84 , srv400456050:84 , srv44584348:84 , srv539468883:84 , srv556577866:84 , srv591240803:84 , srv634866499:84 , srv649382558:84 , srv654019930:84 , srv678017143:84 , srv83032282:84 , srv957880577:84 , srv966942579:84 , srv1087216698:85 , srv1093821896:85 , srv1115534694:85 , srv1138417357:85 , srv1146369582:85 , srv1166951839:85 , srv126327811:85 , srv1275537243:85 , srv1283098034:85 , srv1347935816:85 , srv1515639710:85 , srv1516266023:85 , srv1572756490:85 , srv1670386142:85 , srv1681532658:85 , srv1715275090:85 , srv1724239179:85 , srv1738383639:85 , srv1756076120:85 , srv1767582681:85 , srv1819167859:85 , srv1896435213:85 , srv1901192824:85 , srv2064636135:85 , srv2090038732:85 , srv2095406610:85 , srv2109048180:85 , srv2109088140:85 , srv226973005:85 , srv237026614:85 , srv323082528:85 , srv396579846:85 , srv41785403:85 , srv454192386:85 , srv50538193:85 , srv508165966:85 , srv509542227:85 , srv531799805:85 , srv542513519:85 , srv589522448:85 , srv593185508:85 , srv710343673:85 , srv723277259:85 , srv751091575:85 , srv853714894:85 , srv888638829:85 , srv902394281:85 , srv1736217252:86 , srv1873157147:86 , srv2030084194:86 , srv349987646:86 , srv652010045:86 , srv775817664:86 , srv48182684:630 }
2023-11-15 06:55:19,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:19,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2074972336=50, srv454192386=73, srv1819167859=41, srv1767582681=37, srv1761111341=36, srv1627496141=24, srv1667382494=26, srv1515639710=17, srv539468883=79, srv1901192824=46, srv853714894=95, srv2098627444=54, srv41785403=71, srv23311827=61, srv634866499=85, srv710343673=90, srv902394281=97, srv1672851018=28, srv2095406610=53, srv1138417357=4, srv1731666145=32, srv201145771=47, srv751091575=92, srv219922161=59, srv1577074087=22, srv775817664=93, srv2140243764=58, srv226973005=60, srv1736217252=33, srv542513519=80, srv2109048180=55, srv723277259=91, srv1738383639=34, srv323082528=66, srv1715275090=30, srv957880577=98, srv1461505214=15, srv556577866=81, srv2112948489=57, srv593185508=84, srv1670386142=27, srv1873157147=44, srv1012335422=0, srv1568632150=20, srv1803677860=40, srv400456050=70, srv654019930=88, srv509542227=77, srv888638829=96, srv48182684=74, srv1862685362=42, srv1865675279=43, srv83032282=94, srv1896435213=45, srv1681532658=29, srv1115534694=3, srv237026614=62, srv1789218083=38, srv2109088140=56, srv1801384282=39, srv396579846=69, srv1146369582=5, srv1756076120=35, srv591240803=83, srv2064636135=49, srv1087216698=1, srv349987646=67, srv589522448=82, srv1450970159=13, srv290527530=64, srv508165966=76, srv1093821896=2, srv1598104430=23, srv2090038732=52, srv130196851=11, srv1724239179=31, srv1451635982=14, srv290275468=63, srv44584348=72, srv652010045=87, srv1347935816=12, srv649382558=86, srv308626153=65, srv1516266023=18, srv1275537243=9, srv1637927050=25, srv50538193=75, srv2030084194=48, srv1166951839=6, srv1283098034=10, srv966942579=99, srv1485579332=16, srv2077812505=51, srv531799805=78, srv1175956773=7, srv1546344392=19, srv365890865=68, srv678017143=89, srv126327811=8, srv1572756490=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:19,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:19,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-15 06:55:19,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-15 06:55:19,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-15 06:55:19,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-15 06:55:19,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-15 06:55:19,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-15 06:55:19,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-15 06:55:19,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-15 06:55:20,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.1060607277283735E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:20,008 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1461505214:83 , srv1577074087:83 , srv1627496141:83 , srv2098627444:83 , srv308626153:83 , srv1012335422:84 , srv1175956773:84 , srv130196851:84 , srv1450970159:84 , srv1451635982:84 , srv1485579332:84 , srv1546344392:84 , srv1568632150:84 , srv1598104430:84 , srv1637927050:84 , srv1667382494:84 , srv1672851018:84 , srv1731666145:84 , srv1761111341:84 , srv1789218083:84 , srv1801384282:84 , srv1803677860:84 , srv1862685362:84 , srv1865675279:84 , srv201145771:84 , srv2074972336:84 , srv2077812505:84 , srv2112948489:84 , srv2140243764:84 , srv219922161:84 , srv23311827:84 , srv290275468:84 , srv290527530:84 , srv365890865:84 , srv400456050:84 , srv44584348:84 , srv539468883:84 , srv556577866:84 , srv591240803:84 , srv634866499:84 , srv649382558:84 , srv654019930:84 , srv678017143:84 , srv83032282:84 , srv957880577:84 , srv966942579:84 , srv1087216698:85 , srv1093821896:85 , srv1115534694:85 , srv1138417357:85 , srv1146369582:85 , srv1166951839:85 , srv126327811:85 , srv1275537243:85 , srv1283098034:85 , srv1347935816:85 , srv1515639710:85 , srv1516266023:85 , srv1572756490:85 , srv1670386142:85 , srv1681532658:85 , srv1715275090:85 , srv1724239179:85 , srv1738383639:85 , srv1756076120:85 , srv1767582681:85 , srv1819167859:85 , srv1896435213:85 , srv1901192824:85 , srv2064636135:85 , srv2090038732:85 , srv2095406610:85 , srv2109048180:85 , srv2109088140:85 , srv226973005:85 , srv237026614:85 , srv323082528:85 , srv396579846:85 , srv41785403:85 , srv454192386:85 , srv50538193:85 , srv508165966:85 , srv509542227:85 , srv531799805:85 , srv542513519:85 , srv589522448:85 , srv593185508:85 , srv710343673:85 , srv723277259:85 , srv751091575:85 , srv853714894:85 , srv888638829:85 , srv902394281:85 , srv1736217252:86 , srv1873157147:86 , srv2030084194:86 , srv349987646:86 , srv652010045:86 , srv775817664:86 , srv48182684:630 }
2023-11-15 06:55:20,035 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=117 (was 117), ProcessCount=173 (was 173), AvailableMemoryMB=1237 (was 1713)
2023-11-15 06:55:20,043 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=117, ProcessCount=173, AvailableMemoryMB=1236
2023-11-15 06:55:20,044 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-15 06:55:20,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-15 06:55:20,058 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1010440620:84 , srv113317555:84 , srv1152313886:84 , srv1239765352:84 , srv1247934145:84 , srv1259002563:84 , srv1339391583:84 , srv1351421789:84 , srv1556975740:84 , srv1710591663:84 , srv1740581022:84 , srv1749218738:84 , srv1799647068:84 , srv1855401284:84 , srv1884383306:84 , srv189112015:84 , srv2004459768:84 , srv2027904743:84 , srv2061004395:84 , srv2063354295:84 , srv2077515281:84 , srv253098166:84 , srv281023994:84 , srv319822959:84 , srv34269437:84 , srv829115426:84 , srv885562690:84 , srv940276788:84 , srv972251283:84 , srv1908949269:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-15 06:55:20,059 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:55:20,060 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010440620=0, srv1239765352=3, srv1152313886=2, srv253098166=22, srv1749218738=11, srv1884383306=14, srv1351421789=7, srv319822959=24, srv2061004395=19, srv2027904743=18, srv1556975740=8, srv1710591663=9, srv2004459768=17, srv2063354295=20, srv189112015=15, srv34269437=25, srv1247934145=4, srv1908949269=16, srv2077515281=21, srv281023994=23, srv1259002563=5, srv1799647068=12, srv1740581022=10, srv940276788=28, srv972251283=29, srv829115426=26, srv1339391583=6, srv113317555=1, srv885562690=27, srv1855401284=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:55:20,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:55:20,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-15 06:55:20,086 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1293809129883512, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:55:20,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991260071829643, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1293809129883512, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-15 06:57:20,073 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6109694 different iterations.  Found a solution that moves 1863 regions; Going from a computed imbalance of 0.991260071829643 to a new imbalance of 4.3483349388262195E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.69, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:57:20,080 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1010440620:90 , srv113317555:90 , srv1152313886:90 , srv1239765352:90 , srv1247934145:90 , srv1259002563:90 , srv1339391583:90 , srv1351421789:90 , srv1556975740:90 , srv1710591663:90 , srv1740581022:90 , srv1749218738:90 , srv1799647068:90 , srv1855401284:90 , srv1884383306:90 , srv189112015:90 , srv1908949269:90 , srv2004459768:90 , srv2027904743:90 , srv2061004395:90 , srv2063354295:90 , srv2077515281:90 , srv253098166:90 , srv281023994:90 , srv319822959:90 , srv34269437:90 , srv829115426:90 , srv885562690:90 , srv940276788:90 , srv972251283:90 }
2023-11-15 06:57:20,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-15 06:57:20,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1010440620=0, srv1239765352=3, srv1152313886=2, srv253098166=22, srv1749218738=11, srv1884383306=14, srv1351421789=7, srv319822959=24, srv2061004395=19, srv2027904743=18, srv1556975740=8, srv1710591663=9, srv2004459768=17, srv2063354295=20, srv189112015=15, srv34269437=25, srv1247934145=4, srv1908949269=16, srv2077515281=21, srv281023994=23, srv1259002563=5, srv1799647068=12, srv1740581022=10, srv940276788=28, srv972251283=29, srv829115426=26, srv1339391583=6, srv113317555=1, srv885562690=27, srv1855401284=13} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-15 06:57:20,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-15 06:57:20,088 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-15 06:57:20,089 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-15 06:57:20,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-15 06:57:20,107 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-15 06:57:20,107 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1010440620:90 , srv113317555:90 , srv1152313886:90 , srv1239765352:90 , srv1247934145:90 , srv1259002563:90 , srv1339391583:90 , srv1351421789:90 , srv1556975740:90 , srv1710591663:90 , srv1740581022:90 , srv1749218738:90 , srv1799647068:90 , srv1855401284:90 , srv1884383306:90 , srv189112015:90 , srv1908949269:90 , srv2004459768:90 , srv2027904743:90 , srv2061004395:90 , srv2063354295:90 , srv2077515281:90 , srv253098166:90 , srv281023994:90 , srv319822959:90 , srv34269437:90 , srv829115426:90 , srv885562690:90 , srv940276788:90 , srv972251283:90 }
2023-11-15 06:57:20,122 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 117) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 173), AvailableMemoryMB=1422 (was 1236) - AvailableMemoryMB LEAK? -