2024-04-09 14:55:22,853 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-09 14:55:23,114 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-09 14:55:23,207 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-09 14:55:23,261 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-09 14:55:23,268 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-09 14:55:23,280 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=179, AvailableMemoryMB=2669
2024-04-09 14:55:23,282 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-09 14:55:23,282 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-09 14:55:23,400 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013174571:84 , srv1098413596:84 , srv1120137753:84 , srv1128276518:84 , srv1151540541:84 , srv1152849759:84 , srv1155415377:84 , srv1166587706:84 , srv1175466236:84 , srv1205451771:84 , srv128097638:84 , srv1306563696:84 , srv1311603471:84 , srv1327854836:84 , srv1327968927:84 , srv1334198996:84 , srv1344802720:84 , srv1355627842:84 , srv1375274931:84 , srv140463339:84 , srv1409453218:84 , srv1436157888:84 , srv1439371810:84 , srv1451013843:84 , srv1460366343:84 , srv1474195694:84 , srv1481378260:84 , srv1503745159:84 , srv1527766055:84 , srv1559919499:84 , srv1576393422:84 , srv1585155812:84 , srv1587532653:84 , srv1601514713:84 , srv1631263094:84 , srv1650464623:84 , srv1651289885:84 , srv1683384949:84 , srv168931245:84 , srv1712447068:84 , srv1784166993:84 , srv179861315:84 , srv1804041838:84 , srv1829463616:84 , srv1843646937:84 , srv1844023379:84 , srv1855504795:84 , srv1869559174:84 , srv1874178624:84 , srv1898048803:84 , srv1916287208:84 , srv1959993451:84 , srv201392960:84 , srv2017517942:84 , srv2031057468:84 , srv205689502:84 , srv2075823067:84 , srv226649846:84 , srv231629609:84 , srv259223050:84 , srv265118981:84 , srv279630391:84 , srv284676041:84 , srv307992341:84 , srv308385831:84 , srv312001858:84 , srv324728305:84 , srv372651335:84 , srv387402537:84 , srv415294473:84 , srv415891236:84 , srv417254759:84 , srv421874111:84 , srv437183244:84 , srv466798882:84 , srv480906407:84 , srv521189995:84 , srv536111759:84 , srv566386145:84 , srv575748118:84 , srv593734459:84 , srv597598383:84 , srv601926483:84 , srv626094208:84 , srv64066132:84 , srv682100635:84 , srv708643627:84 , srv71019478:84 , srv716415401:84 , srv72780065:84 , srv738498004:84 , srv796000497:84 , srv852920416:84 , srv868913476:84 , srv887436137:84 , srv891985060:84 , srv924974718:84 , srv962246104:84 , srv992926795:84 , srv261637335:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-09 14:55:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:23,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:23,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:23,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:23,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:23,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:23,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:23,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:23,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:23,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:23,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:23,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:23,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:23,608 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-09 14:55:23,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-09 14:55:23,857 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 347 ms to try 5000 different iterations.  Found a solution that moves 4693 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1814473247719952. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749248584150407, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05683180532519413, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5214444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749248584150407, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:23,868 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv924974718:81 , srv1098413596:83 , srv1152849759:83 , srv1576393422:83 , srv1650464623:83 , srv226649846:83 , srv437183244:83 , srv521189995:83 , srv852920416:83 , srv1166587706:84 , srv1306563696:84 , srv1334198996:84 , srv1481378260:84 , srv1503745159:84 , srv1683384949:84 , srv1804041838:84 , srv265118981:84 , srv387402537:84 , srv597598383:84 , srv1355627842:85 , srv1375274931:85 , srv1451013843:85 , srv1587532653:85 , srv179861315:85 , srv1843646937:85 , srv1855504795:85 , srv1916287208:85 , srv2031057468:85 , srv231629609:85 , srv259223050:85 , srv279630391:85 , srv308385831:85 , srv324728305:85 , srv566386145:85 , srv601926483:85 , srv708643627:85 , srv992926795:85 , srv1120137753:86 , srv1344802720:86 , srv1439371810:86 , srv1527766055:86 , srv1651289885:86 , srv1829463616:86 , srv1844023379:86 , srv1869559174:86 , srv1874178624:86 , srv2075823067:86 , srv312001858:86 , srv415891236:86 , srv480906407:86 , srv593734459:86 , srv64066132:86 , srv682100635:86 , srv962246104:86 , srv1151540541:87 , srv1311603471:87 , srv1327854836:87 , srv1436157888:87 , srv1559919499:87 , srv1585155812:87 , srv1898048803:87 , srv1959993451:87 , srv2017517942:87 , srv205689502:87 , srv307992341:87 , srv415294473:87 , srv466798882:87 , srv626094208:87 , srv738498004:87 , srv868913476:87 , srv1128276518:88 , srv128097638:88 , srv140463339:88 , srv1601514713:88 , srv1712447068:88 , srv1784166993:88 , srv284676041:88 , srv417254759:88 , srv716415401:88 , srv796000497:88 , srv887436137:88 , srv891985060:88 , srv1327968927:89 , srv1474195694:89 , srv168931245:89 , srv72780065:89 , srv1155415377:90 , srv421874111:90 , srv1013174571:91 , srv1175466236:91 , srv1205451771:91 , srv1631263094:91 , srv1409453218:92 , srv536111759:92 , srv575748118:92 , srv1460366343:93 , srv372651335:94 , srv71019478:94 , srv201392960:95 , srv261637335:423 }
2024-04-09 14:55:23,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:23,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:23,887 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:23,888 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:23,889 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:23,890 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:23,891 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:23,892 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:23,893 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:23,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:23,994 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749248584150407, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05683180532519413, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749248584150407, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:23,994 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-09 14:55:23,995 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18141446368364111, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03749248584150407, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05683180532519413, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03749248584150407, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.177, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24025, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-09 14:55:24,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 255 ms to try 5000 different iterations.  Found a solution that moves 2622 regions; Going from a computed imbalance of 0.18141446368364111 to a new imbalance of 0.01557023018409341. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022842630295629177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0404686352340975, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29133333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022842630295629177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,178 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv201392960:75 , srv1409453218:78 , srv1460366343:78 , srv71019478:79 , srv1631263094:80 , srv1175466236:81 , srv1474195694:81 , srv372651335:81 , srv575748118:81 , srv1013174571:82 , srv128097638:82 , srv1327968927:82 , srv168931245:82 , srv1151540541:83 , srv1205451771:83 , srv140463339:83 , srv1436157888:83 , srv1784166993:83 , srv179861315:83 , srv307992341:83 , srv536111759:83 , srv716415401:83 , srv1120137753:84 , srv1155415377:84 , srv1311603471:84 , srv1327854836:84 , srv1559919499:84 , srv1601514713:84 , srv1712447068:84 , srv1959993451:84 , srv259223050:84 , srv284676041:84 , srv415294473:84 , srv466798882:84 , srv626094208:84 , srv796000497:84 , srv887436137:84 , srv891985060:84 , srv1344802720:85 , srv1527766055:85 , srv1585155812:85 , srv1587532653:85 , srv1651289885:85 , srv1898048803:85 , srv2075823067:85 , srv415891236:85 , srv593734459:85 , srv64066132:85 , srv682100635:85 , srv708643627:85 , srv868913476:85 , srv1128276518:86 , srv1355627842:86 , srv1439371810:86 , srv1869559174:86 , srv2017517942:86 , srv205689502:86 , srv265118981:86 , srv308385831:86 , srv417254759:86 , srv421874111:86 , srv72780065:86 , srv962246104:86 , srv1166587706:87 , srv1576393422:87 , srv1804041838:87 , srv1829463616:87 , srv1843646937:87 , srv1844023379:87 , srv1855504795:87 , srv1916287208:87 , srv231629609:87 , srv312001858:87 , srv324728305:87 , srv521189995:87 , srv738498004:87 , srv992926795:87 , srv1334198996:88 , srv1375274931:88 , srv1451013843:88 , srv1874178624:88 , srv2031057468:88 , srv480906407:88 , srv566386145:88 , srv601926483:88 , srv1098413596:89 , srv1306563696:89 , srv1481378260:89 , srv1503745159:89 , srv1650464623:89 , srv226649846:89 , srv387402537:89 , srv437183244:89 , srv597598383:89 , srv1152849759:90 , srv1683384949:90 , srv279630391:91 , srv852920416:91 , srv924974718:91 , srv261637335:554 }
2024-04-09 14:55:24,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:24,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:24,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:24,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:24,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:24,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:24,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:24,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:24,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:24,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:24,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:24,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:24,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:24,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:24,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:24,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:24,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:24,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:24,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:24,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022842630295629177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0404686352340975, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022842630295629177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,313 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-09 14:55:24,313 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01555187054768503, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022842630295629177); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0404686352340975, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022842630295629177); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-09 14:55:24,470 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 233 ms to try 5000 different iterations.  Found a solution that moves 1066 regions; Going from a computed imbalance of 0.01555187054768503 to a new imbalance of 7.172880214387981E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0074477018519587814); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.11844444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0074477018519587814); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,472 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv279630391:81 , srv421874111:82 , srv72780065:82 , srv1013174571:83 , srv1128276518:83 , srv1155415377:83 , srv1205451771:83 , srv1683384949:83 , srv1874178624:83 , srv2017517942:83 , srv417254759:83 , srv480906407:83 , srv536111759:83 , srv738498004:83 , srv852920416:83 , srv1152849759:84 , srv1306563696:84 , srv1375274931:84 , srv1503745159:84 , srv1855504795:84 , srv372651335:84 , srv566386145:84 , srv575748118:84 , srv601926483:84 , srv1098413596:85 , srv1355627842:85 , srv1439371810:85 , srv1451013843:85 , srv1481378260:85 , srv1601514713:85 , srv1650464623:85 , srv1829463616:85 , srv1843646937:85 , srv1844023379:85 , srv1869559174:85 , srv1898048803:85 , srv1916287208:85 , srv1959993451:85 , srv2031057468:85 , srv205689502:85 , srv284676041:85 , srv312001858:85 , srv387402537:85 , srv597598383:85 , srv682100635:85 , srv71019478:85 , srv868913476:85 , srv891985060:85 , srv1151540541:86 , srv1166587706:86 , srv1175466236:86 , srv1311603471:86 , srv1327854836:86 , srv1327968927:86 , srv1334198996:86 , srv1409453218:86 , srv1460366343:86 , srv1527766055:86 , srv1559919499:86 , srv1585155812:86 , srv1631263094:86 , srv1651289885:86 , srv168931245:86 , srv2075823067:86 , srv226649846:86 , srv265118981:86 , srv324728305:86 , srv415294473:86 , srv415891236:86 , srv437183244:86 , srv593734459:86 , srv626094208:86 , srv796000497:86 , srv887436137:86 , srv924974718:86 , srv962246104:86 , srv1120137753:87 , srv128097638:87 , srv1344802720:87 , srv140463339:87 , srv1474195694:87 , srv1587532653:87 , srv1712447068:87 , srv1784166993:87 , srv1804041838:87 , srv201392960:87 , srv231629609:87 , srv307992341:87 , srv308385831:87 , srv466798882:87 , srv521189995:87 , srv64066132:87 , srv708643627:87 , srv716415401:87 , srv992926795:87 , srv1436157888:88 , srv1576393422:88 , srv259223050:89 , srv179861315:90 , srv261637335:547 }
2024-04-09 14:55:24,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:24,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:24,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:24,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:24,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:24,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:24,490 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:24,491 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:24,492 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:24,493 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:24,494 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:24,495 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:24,579 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0074477018519587814); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0074477018519587814); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,579 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-09 14:55:24,579 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.098237299012961E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0074477018519587814); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009721139910896655); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0074477018519587814); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-09 14:55:24,808 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 304 ms to try 5000 different iterations.  Found a solution that moves 268 regions; Going from a computed imbalance of 7.098237299012961E-4 to a new imbalance of 2.6724075562098184E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.029777777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,809 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1712447068:83 , srv231629609:83 , srv312001858:83 , srv372651335:83 , srv962246104:83 , srv992926795:83 , srv1128276518:84 , srv1175466236:84 , srv1334198996:84 , srv1344802720:84 , srv140463339:84 , srv1436157888:84 , srv1451013843:84 , srv1460366343:84 , srv1481378260:84 , srv1576393422:84 , srv1585155812:84 , srv1784166993:84 , srv179861315:84 , srv1804041838:84 , srv1844023379:84 , srv2031057468:84 , srv205689502:84 , srv226649846:84 , srv259223050:84 , srv308385831:84 , srv324728305:84 , srv387402537:84 , srv421874111:84 , srv437183244:84 , srv466798882:84 , srv536111759:84 , srv597598383:84 , srv64066132:84 , srv796000497:84 , srv887436137:84 , srv924974718:84 , srv1098413596:85 , srv1120137753:85 , srv1151540541:85 , srv1152849759:85 , srv1155415377:85 , srv1166587706:85 , srv1205451771:85 , srv128097638:85 , srv1311603471:85 , srv1327854836:85 , srv1375274931:85 , srv1439371810:85 , srv1474195694:85 , srv1503745159:85 , srv1527766055:85 , srv1559919499:85 , srv1587532653:85 , srv1601514713:85 , srv1631263094:85 , srv1650464623:85 , srv1651289885:85 , srv1683384949:85 , srv168931245:85 , srv1829463616:85 , srv1843646937:85 , srv1869559174:85 , srv1874178624:85 , srv1898048803:85 , srv1916287208:85 , srv201392960:85 , srv2075823067:85 , srv279630391:85 , srv284676041:85 , srv307992341:85 , srv415294473:85 , srv415891236:85 , srv417254759:85 , srv480906407:85 , srv521189995:85 , srv566386145:85 , srv575748118:85 , srv593734459:85 , srv601926483:85 , srv626094208:85 , srv708643627:85 , srv71019478:85 , srv716415401:85 , srv72780065:85 , srv738498004:85 , srv852920416:85 , srv868913476:85 , srv891985060:85 , srv1013174571:86 , srv1306563696:86 , srv1327968927:86 , srv1355627842:86 , srv1409453218:86 , srv1855504795:86 , srv1959993451:86 , srv2017517942:86 , srv682100635:86 , srv265118981:87 , srv261637335:617 }
2024-04-09 14:55:24,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:24,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:24,822 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:24,823 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:24,824 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:24,825 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:24,826 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:24,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:24,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:24,910 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:24,911 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-09 14:55:24,911 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4847499453232764E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017727200782610348); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-09 14:55:25,067 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 232 ms to try 5000 different iterations.  Found a solution that moves 20 regions; Going from a computed imbalance of 2.4847499453232764E-5 to a new imbalance of 6.88411204703086E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0022222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:25,068 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1306563696:83 , srv1327968927:83 , srv1829463616:83 , srv265118981:83 , srv71019478:83 , srv716415401:83 , srv1013174571:84 , srv1098413596:84 , srv1120137753:84 , srv1152849759:84 , srv1155415377:84 , srv1166587706:84 , srv1175466236:84 , srv1205451771:84 , srv128097638:84 , srv1311603471:84 , srv1327854836:84 , srv1334198996:84 , srv1344802720:84 , srv1355627842:84 , srv1375274931:84 , srv140463339:84 , srv1409453218:84 , srv1436157888:84 , srv1439371810:84 , srv1451013843:84 , srv1474195694:84 , srv1481378260:84 , srv1503745159:84 , srv1527766055:84 , srv1559919499:84 , srv1576393422:84 , srv1585155812:84 , srv1587532653:84 , srv1601514713:84 , srv1631263094:84 , srv1650464623:84 , srv1651289885:84 , srv1683384949:84 , srv168931245:84 , srv1712447068:84 , srv1784166993:84 , srv179861315:84 , srv1804041838:84 , srv1843646937:84 , srv1844023379:84 , srv1855504795:84 , srv1869559174:84 , srv1874178624:84 , srv1898048803:84 , srv1916287208:84 , srv1959993451:84 , srv201392960:84 , srv2017517942:84 , srv2031057468:84 , srv205689502:84 , srv2075823067:84 , srv226649846:84 , srv231629609:84 , srv259223050:84 , srv279630391:84 , srv284676041:84 , srv307992341:84 , srv308385831:84 , srv324728305:84 , srv372651335:84 , srv387402537:84 , srv415294473:84 , srv415891236:84 , srv417254759:84 , srv421874111:84 , srv437183244:84 , srv466798882:84 , srv480906407:84 , srv521189995:84 , srv536111759:84 , srv566386145:84 , srv575748118:84 , srv593734459:84 , srv597598383:84 , srv601926483:84 , srv626094208:84 , srv64066132:84 , srv682100635:84 , srv708643627:84 , srv72780065:84 , srv738498004:84 , srv796000497:84 , srv852920416:84 , srv868913476:84 , srv887436137:84 , srv891985060:84 , srv924974718:84 , srv992926795:84 , srv1128276518:85 , srv1151540541:85 , srv1460366343:85 , srv312001858:85 , srv962246104:85 , srv261637335:685 }
2024-04-09 14:55:25,071 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:25,072 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv265118981=61, srv716415401=89, srv1650464623=35, srv1576393422=30, srv796000497=92, srv1166587706=7, srv868913476=94, srv1559919499=29, srv480906407=76, srv1436157888=21, srv1855504795=46, srv284676041=63, srv708643627=87, srv1874178624=48, srv71019478=88, srv1311603471=12, srv1587532653=32, srv924974718=97, srv466798882=75, srv1175466236=8, srv1503745159=27, srv575748118=80, srv992926795=99, srv168931245=38, srv1474195694=25, srv231629609=58, srv312001858=66, srv1327854836=13, srv205689502=55, srv1327968927=14, srv372651335=68, srv1128276518=3, srv2031057468=54, srv259223050=59, srv597598383=82, srv601926483=83, srv962246104=98, srv1460366343=24, srv261637335=60, srv201392960=52, srv387402537=69, srv626094208=84, srv1205451771=9, srv891985060=96, srv1712447068=39, srv1804041838=42, srv1098413596=1, srv1601514713=33, srv226649846=57, srv1120137753=2, srv521189995=77, srv1631263094=34, srv1844023379=45, srv1651289885=36, srv1898048803=49, srv1334198996=15, srv1355627842=17, srv1375274931=18, srv140463339=19, srv179861315=41, srv1306563696=11, srv279630391=62, srv682100635=86, srv308385831=65, srv1451013843=23, srv738498004=91, srv417254759=72, srv2075823067=56, srv1155415377=6, srv64066132=85, srv1439371810=22, srv1013174571=0, srv1784166993=40, srv437183244=74, srv1151540541=4, srv1344802720=16, srv2017517942=53, srv307992341=64, srv566386145=79, srv415294473=70, srv1152849759=5, srv593734459=81, srv536111759=78, srv1869559174=47, srv421874111=73, srv1829463616=43, srv1843646937=44, srv1527766055=28, srv1585155812=31, srv72780065=90, srv852920416=93, srv324728305=67, srv887436137=95, srv1959993451=51, srv1683384949=37, srv1916287208=50, srv415891236=71, srv128097638=10, srv1481378260=26, srv1409453218=20} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:25,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:25,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:25,090 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:25,091 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:25,092 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-09 14:55:25,093 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-09 14:55:25,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-09 14:55:25,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-09 14:55:25,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-09 14:55:25,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-09 14:55:25,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-09 14:55:25,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.744069053831948E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014982219165849825); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:25,190 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1306563696:83 , srv1327968927:83 , srv1829463616:83 , srv265118981:83 , srv71019478:83 , srv716415401:83 , srv1013174571:84 , srv1098413596:84 , srv1120137753:84 , srv1152849759:84 , srv1155415377:84 , srv1166587706:84 , srv1175466236:84 , srv1205451771:84 , srv128097638:84 , srv1311603471:84 , srv1327854836:84 , srv1334198996:84 , srv1344802720:84 , srv1355627842:84 , srv1375274931:84 , srv140463339:84 , srv1409453218:84 , srv1436157888:84 , srv1439371810:84 , srv1451013843:84 , srv1474195694:84 , srv1481378260:84 , srv1503745159:84 , srv1527766055:84 , srv1559919499:84 , srv1576393422:84 , srv1585155812:84 , srv1587532653:84 , srv1601514713:84 , srv1631263094:84 , srv1650464623:84 , srv1651289885:84 , srv1683384949:84 , srv168931245:84 , srv1712447068:84 , srv1784166993:84 , srv179861315:84 , srv1804041838:84 , srv1843646937:84 , srv1844023379:84 , srv1855504795:84 , srv1869559174:84 , srv1874178624:84 , srv1898048803:84 , srv1916287208:84 , srv1959993451:84 , srv201392960:84 , srv2017517942:84 , srv2031057468:84 , srv205689502:84 , srv2075823067:84 , srv226649846:84 , srv231629609:84 , srv259223050:84 , srv279630391:84 , srv284676041:84 , srv307992341:84 , srv308385831:84 , srv324728305:84 , srv372651335:84 , srv387402537:84 , srv415294473:84 , srv415891236:84 , srv417254759:84 , srv421874111:84 , srv437183244:84 , srv466798882:84 , srv480906407:84 , srv521189995:84 , srv536111759:84 , srv566386145:84 , srv575748118:84 , srv593734459:84 , srv597598383:84 , srv601926483:84 , srv626094208:84 , srv64066132:84 , srv682100635:84 , srv708643627:84 , srv72780065:84 , srv738498004:84 , srv796000497:84 , srv852920416:84 , srv868913476:84 , srv887436137:84 , srv891985060:84 , srv924974718:84 , srv992926795:84 , srv1128276518:85 , srv1151540541:85 , srv1460366343:85 , srv312001858:85 , srv962246104:85 , srv261637335:685 }
2024-04-09 14:55:25,221 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=136 (was 136), ProcessCount=179 (was 179), AvailableMemoryMB=2174 (was 2669)
2024-04-09 14:55:25,229 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=136, ProcessCount=179, AvailableMemoryMB=2174
2024-04-09 14:55:25,229 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-09 14:55:25,230 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-09 14:55:25,241 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1100170474:84 , srv1315225757:84 , srv1333450143:84 , srv1355260549:84 , srv1425034377:84 , srv1436814145:84 , srv1441932638:84 , srv1458317677:84 , srv1531841928:84 , srv1565245263:84 , srv1592716242:84 , srv1642897806:84 , srv1770944306:84 , srv1847475948:84 , srv1986347796:84 , srv2010553957:84 , srv20389207:84 , srv20523593:84 , srv214772540:84 , srv226550306:84 , srv243353238:84 , srv288833151:84 , srv319213249:84 , srv341368275:84 , srv397009602:84 , srv628544616:84 , srv659023627:84 , srv745900340:84 , srv988498969:84 , srv1786238040:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-09 14:55:25,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:55:25,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv243353238=21, srv1315225757=1, srv1986347796=15, srv628544616=26, srv1441932638=6, srv226550306=20, srv1592716242=10, srv341368275=24, srv1786238040=13, srv288833151=22, srv20389207=17, srv1642897806=11, srv20523593=18, srv1436814145=5, srv214772540=19, srv745900340=28, srv1531841928=8, srv1333450143=2, srv1425034377=4, srv1847475948=14, srv1100170474=0, srv1355260549=3, srv1565245263=9, srv2010553957=16, srv397009602=25, srv659023627=27, srv319213249=23, srv1458317677=7, srv1770944306=12, srv988498969=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:55:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:55:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:55:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:55:25,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:55:25,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:55:25,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:55:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:55:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:55:25,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-09 14:55:25,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0792763165472805, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:55:25,293 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912442840349112, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0792763165472805, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-09 14:57:25,263 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9024631 different iterations.  Found a solution that moves 1842 regions; Going from a computed imbalance of 0.9912442840349112 to a new imbalance of 4.2993198912066E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:57:25,268 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1100170474:90 , srv1315225757:90 , srv1333450143:90 , srv1355260549:90 , srv1425034377:90 , srv1436814145:90 , srv1441932638:90 , srv1458317677:90 , srv1531841928:90 , srv1565245263:90 , srv1592716242:90 , srv1642897806:90 , srv1770944306:90 , srv1786238040:90 , srv1847475948:90 , srv1986347796:90 , srv2010553957:90 , srv20389207:90 , srv20523593:90 , srv214772540:90 , srv226550306:90 , srv243353238:90 , srv288833151:90 , srv319213249:90 , srv341368275:90 , srv397009602:90 , srv628544616:90 , srv659023627:90 , srv745900340:90 , srv988498969:90 }
2024-04-09 14:57:25,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-09 14:57:25,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv243353238=21, srv1315225757=1, srv1986347796=15, srv628544616=26, srv1441932638=6, srv226550306=20, srv1592716242=10, srv341368275=24, srv1786238040=13, srv288833151=22, srv20389207=17, srv1642897806=11, srv20523593=18, srv1436814145=5, srv214772540=19, srv745900340=28, srv1531841928=8, srv1333450143=2, srv1425034377=4, srv1847475948=14, srv1100170474=0, srv1355260549=3, srv1565245263=9, srv2010553957=16, srv397009602=25, srv659023627=27, srv319213249=23, srv1458317677=7, srv1770944306=12, srv988498969=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-09 14:57:25,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-09 14:57:25,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-09 14:57:25,285 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-09 14:57:25,285 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1100170474:90 , srv1315225757:90 , srv1333450143:90 , srv1355260549:90 , srv1425034377:90 , srv1436814145:90 , srv1441932638:90 , srv1458317677:90 , srv1531841928:90 , srv1565245263:90 , srv1592716242:90 , srv1642897806:90 , srv1770944306:90 , srv1786238040:90 , srv1847475948:90 , srv1986347796:90 , srv2010553957:90 , srv20389207:90 , srv20523593:90 , srv214772540:90 , srv226550306:90 , srv243353238:90 , srv288833151:90 , srv319213249:90 , srv341368275:90 , srv397009602:90 , srv628544616:90 , srv659023627:90 , srv745900340:90 , srv988498969:90 }
2024-04-09 14:57:25,298 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 136) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 179), AvailableMemoryMB=3304 (was 2174) - AvailableMemoryMB LEAK? -