2023-04-05 12:56:37,880 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-05 12:56:38,172 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-05 12:56:38,275 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-05 12:56:38,330 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 12:56:38,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 12:56:38,350 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=426, ProcessCount=169, AvailableMemoryMB=2055
2023-04-05 12:56:38,352 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 12:56:38,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-05 12:56:38,469 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1004208943:84 , srv1033188874:84 , srv1062718200:84 , srv1073178495:84 , srv1098724159:84 , srv1110258101:84 , srv1113258792:84 , srv1141598821:84 , srv119017403:84 , srv1193633153:84 , srv1214509444:84 , srv1222966313:84 , srv1235432221:84 , srv1235840703:84 , srv1248399307:84 , srv1249266716:84 , srv126526815:84 , srv1298975546:84 , srv1333896448:84 , srv1350377401:84 , srv1353280618:84 , srv135817546:84 , srv1377971425:84 , srv1394872450:84 , srv1406754320:84 , srv1431604755:84 , srv1442447242:84 , srv1472545220:84 , srv1475794399:84 , srv1520070984:84 , srv1524778057:84 , srv157306299:84 , srv1574654928:84 , srv1618870033:84 , srv1620791358:84 , srv1629854288:84 , srv16657119:84 , srv1695293354:84 , srv1697485273:84 , srv1701785373:84 , srv1713045396:84 , srv1716532182:84 , srv1740727677:84 , srv1747792359:84 , srv1756095947:84 , srv1865220465:84 , srv1871219245:84 , srv1910512086:84 , srv1911711192:84 , srv1952028979:84 , srv2017075571:84 , srv2025110693:84 , srv2056684205:84 , srv2065501274:84 , srv2085184083:84 , srv2105291090:84 , srv2129511855:84 , srv219297980:84 , srv230100560:84 , srv235014547:84 , srv267613522:84 , srv279779001:84 , srv330562573:84 , srv341577120:84 , srv345613039:84 , srv347824426:84 , srv366889619:84 , srv367367578:84 , srv368218382:84 , srv394223862:84 , srv399992645:84 , srv40066362:84 , srv417045670:84 , srv441982951:84 , srv488898577:84 , srv492011520:84 , srv520662677:84 , srv530692184:84 , srv568473763:84 , srv605790891:84 , srv640063152:84 , srv652521025:84 , srv671876975:84 , srv682909391:84 , srv693946139:84 , srv710026069:84 , srv757099655:84 , srv778357981:84 , srv780402886:84 , srv815167635:84 , srv822363966:84 , srv841978073:84 , srv883103878:84 , srv918040438:84 , srv957815927:84 , srv969235441:84 , srv980908774:84 , srv995375217:84 , srv996371796:84 , srv1386551451:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-05 12:56:38,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:38,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1475794399=29, srv778357981=88, srv1695293354=38, srv1062718200=2, srv1098724159=4, srv2056684205=53, srv367367578=68, srv366889619=67, srv1386551451=23, srv1618870033=34, srv757099655=87, srv399992645=71, srv2065501274=54, srv1871219245=47, srv394223862=70, srv135817546=21, srv1073178495=3, srv996371796=99, srv1249266716=15, srv441982951=74, srv2017075571=51, srv1193633153=9, srv1406754320=25, srv1747792359=44, srv1235432221=12, srv368218382=69, srv780402886=89, srv235014547=60, srv1235840703=13, srv1620791358=35, srv1865220465=46, srv1333896448=18, srv1353280618=20, srv530692184=78, srv2129511855=57, srv492011520=76, srv822363966=91, srv40066362=72, srv1629854288=36, srv883103878=93, srv1431604755=26, srv652521025=82, srv918040438=94, srv969235441=96, srv841978073=92, srv815167635=90, srv605790891=80, srv157306299=32, srv1004208943=0, srv957815927=95, srv126526815=16, srv1701785373=40, srv330562573=63, srv341577120=64, srv2085184083=55, srv995375217=98, srv1110258101=5, srv1756095947=45, srv693946139=85, srv347824426=66, srv1520070984=30, srv2025110693=52, srv1574654928=33, srv219297980=58, srv1377971425=22, srv1350377401=19, srv1394872450=24, srv1472545220=28, srv1910512086=48, srv2105291090=56, srv267613522=61, srv1524778057=31, srv1222966313=11, srv1713045396=41, srv710026069=86, srv1298975546=17, srv520662677=77, srv279779001=62, srv671876975=83, srv682909391=84, srv119017403=8, srv1113258792=6, srv640063152=81, srv16657119=37, srv1248399307=14, srv1442447242=27, srv1697485273=39, srv417045670=73, srv345613039=65, srv568473763=79, srv980908774=97, srv1952028979=50, srv1214509444=10, srv230100560=59, srv488898577=75, srv1911711192=49, srv1141598821=7, srv1740727677=43, srv1033188874=1, srv1716532182=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:38,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:38,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:38,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 12:56:38,567 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 12:56:38,568 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 12:56:38,569 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 12:56:38,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 12:56:38,571 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 12:56:38,572 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 12:56:38,573 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 12:56:38,862 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:38,863 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 12:56:38,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 12:56:39,487 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 892 ms to try 5000 different iterations.  Found a solution that moves 4706 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17792771226967358. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0403961552350627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06014199434443582, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5228888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0403961552350627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:39,509 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1865220465:81 , srv1377971425:82 , srv1520070984:82 , srv1574654928:82 , srv1629854288:82 , srv841978073:82 , srv1033188874:83 , srv1442447242:83 , srv1695293354:83 , srv219297980:83 , srv969235441:83 , srv1193633153:84 , srv126526815:84 , srv1298975546:84 , srv1406754320:84 , srv2085184083:84 , srv367367578:84 , srv417045670:84 , srv441982951:84 , srv492011520:84 , srv757099655:84 , srv778357981:84 , srv780402886:84 , srv957815927:84 , srv1141598821:85 , srv135817546:85 , srv157306299:85 , srv1618870033:85 , srv1701785373:85 , srv1747792359:85 , srv2017075571:85 , srv399992645:85 , srv488898577:85 , srv530692184:85 , srv640063152:85 , srv682909391:85 , srv995375217:85 , srv1004208943:86 , srv1062718200:86 , srv1073178495:86 , srv1214509444:86 , srv1235432221:86 , srv1475794399:86 , srv16657119:86 , srv1697485273:86 , srv1740727677:86 , srv1871219245:86 , srv1911711192:86 , srv1952028979:86 , srv2065501274:86 , srv279779001:86 , srv394223862:86 , srv815167635:86 , srv883103878:86 , srv918040438:86 , srv980908774:86 , srv996371796:86 , srv1248399307:87 , srv1394872450:87 , srv1524778057:87 , srv1716532182:87 , srv1756095947:87 , srv2025110693:87 , srv2056684205:87 , srv2105291090:87 , srv230100560:87 , srv40066362:87 , srv568473763:87 , srv605790891:87 , srv652521025:87 , srv119017403:88 , srv1235840703:88 , srv1333896448:88 , srv1431604755:88 , srv1713045396:88 , srv1910512086:88 , srv235014547:88 , srv267613522:88 , srv341577120:88 , srv347824426:88 , srv368218382:88 , srv822363966:88 , srv1098724159:89 , srv1113258792:89 , srv1353280618:89 , srv1472545220:89 , srv345613039:89 , srv366889619:89 , srv1222966313:90 , srv1249266716:90 , srv2129511855:90 , srv1110258101:91 , srv1620791358:91 , srv693946139:91 , srv710026069:91 , srv330562573:93 , srv520662677:93 , srv671876975:93 , srv1350377401:94 , srv1386551451:449 }
2023-04-05 12:56:39,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:39,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1475794399=29, srv778357981=88, srv1695293354=38, srv1062718200=2, srv1098724159=4, srv2056684205=53, srv367367578=68, srv366889619=67, srv1386551451=23, srv1618870033=34, srv757099655=87, srv399992645=71, srv2065501274=54, srv1871219245=47, srv394223862=70, srv135817546=21, srv1073178495=3, srv996371796=99, srv1249266716=15, srv441982951=74, srv2017075571=51, srv1193633153=9, srv1406754320=25, srv1747792359=44, srv1235432221=12, srv368218382=69, srv780402886=89, srv235014547=60, srv1235840703=13, srv1620791358=35, srv1865220465=46, srv1333896448=18, srv1353280618=20, srv530692184=78, srv2129511855=57, srv492011520=76, srv822363966=91, srv40066362=72, srv1629854288=36, srv883103878=93, srv1431604755=26, srv652521025=82, srv918040438=94, srv969235441=96, srv841978073=92, srv815167635=90, srv605790891=80, srv157306299=32, srv1004208943=0, srv957815927=95, srv126526815=16, srv1701785373=40, srv330562573=63, srv341577120=64, srv2085184083=55, srv995375217=98, srv1110258101=5, srv1756095947=45, srv693946139=85, srv347824426=66, srv1520070984=30, srv2025110693=52, srv1574654928=33, srv219297980=58, srv1377971425=22, srv1350377401=19, srv1394872450=24, srv1472545220=28, srv1910512086=48, srv2105291090=56, srv267613522=61, srv1524778057=31, srv1222966313=11, srv1713045396=41, srv710026069=86, srv1298975546=17, srv520662677=77, srv279779001=62, srv671876975=83, srv682909391=84, srv119017403=8, srv1113258792=6, srv640063152=81, srv16657119=37, srv1248399307=14, srv1442447242=27, srv1697485273=39, srv417045670=73, srv345613039=65, srv568473763=79, srv980908774=97, srv1952028979=50, srv1214509444=10, srv230100560=59, srv488898577=75, srv1911711192=49, srv1141598821=7, srv1740727677=43, srv1033188874=1, srv1716532182=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:39,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:39,537 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:39,538 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:39,539 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:39,540 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 12:56:39,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 12:56:39,542 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 12:56:39,543 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 12:56:39,544 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 12:56:39,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 12:56:39,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 12:56:39,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 12:56:39,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 12:56:39,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 12:56:39,548 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 12:56:39,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0403961552350627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06014199434443582, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0403961552350627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:39,719 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 12:56:39,719 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17789476015337388, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0403961552350627, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06014199434443582, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0403961552350627, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17308333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 12:56:40,000 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 417 ms to try 5000 different iterations.  Found a solution that moves 2580 regions; Going from a computed imbalance of 0.17789476015337388 to a new imbalance of 0.016012222518350487. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021149177093497895); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03720299518492452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2866666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021149177093497895); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,009 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv330562573:79 , srv1110258101:80 , srv1350377401:80 , srv693946139:80 , srv520662677:81 , srv671876975:81 , srv1249266716:82 , srv1713045396:82 , srv710026069:82 , srv1113258792:83 , srv1222966313:83 , srv1472545220:83 , srv1620791358:83 , srv1910512086:83 , srv2105291090:83 , srv345613039:83 , srv366889619:83 , srv1098724159:84 , srv119017403:84 , srv1235432221:84 , srv1235840703:84 , srv1248399307:84 , srv1394872450:84 , srv1716532182:84 , srv1740727677:84 , srv1756095947:84 , srv2129511855:84 , srv230100560:84 , srv267613522:84 , srv347824426:84 , srv605790891:84 , srv652521025:84 , srv883103878:84 , srv1004208943:85 , srv1073178495:85 , srv1214509444:85 , srv1333896448:85 , srv1353280618:85 , srv1524778057:85 , srv1911711192:85 , srv1952028979:85 , srv235014547:85 , srv568473763:85 , srv822363966:85 , srv995375217:85 , srv1141598821:86 , srv1406754320:86 , srv1431604755:86 , srv157306299:86 , srv16657119:86 , srv1697485273:86 , srv1747792359:86 , srv1871219245:86 , srv2025110693:86 , srv2056684205:86 , srv2065501274:86 , srv341577120:86 , srv367367578:86 , srv394223862:86 , srv399992645:86 , srv815167635:86 , srv918040438:86 , srv957815927:86 , srv1062718200:87 , srv135817546:87 , srv1475794399:87 , srv1618870033:87 , srv2017075571:87 , srv368218382:87 , srv530692184:87 , srv640063152:87 , srv682909391:87 , srv780402886:87 , srv980908774:87 , srv1033188874:88 , srv1193633153:88 , srv1298975546:88 , srv2085184083:88 , srv417045670:88 , srv757099655:88 , srv778357981:88 , srv969235441:88 , srv126526815:89 , srv1442447242:89 , srv1574654928:89 , srv1695293354:89 , srv1701785373:89 , srv279779001:89 , srv40066362:89 , srv488898577:89 , srv492011520:89 , srv996371796:89 , srv1520070984:90 , srv1865220465:90 , srv219297980:90 , srv841978073:90 , srv1377971425:91 , srv1629854288:91 , srv441982951:91 , srv1386551451:513 }
2023-04-05 12:56:40,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:40,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1475794399=29, srv778357981=88, srv1695293354=38, srv1062718200=2, srv1098724159=4, srv2056684205=53, srv367367578=68, srv366889619=67, srv1386551451=23, srv1618870033=34, srv757099655=87, srv399992645=71, srv2065501274=54, srv1871219245=47, srv394223862=70, srv135817546=21, srv1073178495=3, srv996371796=99, srv1249266716=15, srv441982951=74, srv2017075571=51, srv1193633153=9, srv1406754320=25, srv1747792359=44, srv1235432221=12, srv368218382=69, srv780402886=89, srv235014547=60, srv1235840703=13, srv1620791358=35, srv1865220465=46, srv1333896448=18, srv1353280618=20, srv530692184=78, srv2129511855=57, srv492011520=76, srv822363966=91, srv40066362=72, srv1629854288=36, srv883103878=93, srv1431604755=26, srv652521025=82, srv918040438=94, srv969235441=96, srv841978073=92, srv815167635=90, srv605790891=80, srv157306299=32, srv1004208943=0, srv957815927=95, srv126526815=16, srv1701785373=40, srv330562573=63, srv341577120=64, srv2085184083=55, srv995375217=98, srv1110258101=5, srv1756095947=45, srv693946139=85, srv347824426=66, srv1520070984=30, srv2025110693=52, srv1574654928=33, srv219297980=58, srv1377971425=22, srv1350377401=19, srv1394872450=24, srv1472545220=28, srv1910512086=48, srv2105291090=56, srv267613522=61, srv1524778057=31, srv1222966313=11, srv1713045396=41, srv710026069=86, srv1298975546=17, srv520662677=77, srv279779001=62, srv671876975=83, srv682909391=84, srv119017403=8, srv1113258792=6, srv640063152=81, srv16657119=37, srv1248399307=14, srv1442447242=27, srv1697485273=39, srv417045670=73, srv345613039=65, srv568473763=79, srv980908774=97, srv1952028979=50, srv1214509444=10, srv230100560=59, srv488898577=75, srv1911711192=49, srv1141598821=7, srv1740727677=43, srv1033188874=1, srv1716532182=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:40,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:40,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 12:56:40,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 12:56:40,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 12:56:40,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 12:56:40,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 12:56:40,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 12:56:40,164 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021149177093497895); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03720299518492452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021149177093497895); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,165 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 12:56:40,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01599415697222783, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021149177093497895); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03720299518492452, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021149177093497895); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 12:56:40,428 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 364 ms to try 5000 different iterations.  Found a solution that moves 963 regions; Going from a computed imbalance of 0.01599415697222783 to a new imbalance of 5.869087868854582E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008129761931077195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.107, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008129761931077195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,430 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1620791358:82 , srv40066362:82 , srv1353280618:83 , srv1431604755:83 , srv1701785373:83 , srv279779001:83 , srv341577120:83 , srv368218382:83 , srv441982951:83 , srv520662677:83 , srv671876975:83 , srv1062718200:84 , srv1350377401:84 , srv1618870033:84 , srv1629854288:84 , srv2056684205:84 , srv2065501274:84 , srv2085184083:84 , srv2129511855:84 , srv219297980:84 , srv235014547:84 , srv394223862:84 , srv488898577:84 , srv682909391:84 , srv710026069:84 , srv815167635:84 , srv822363966:84 , srv980908774:84 , srv996371796:84 , srv1098724159:85 , srv1141598821:85 , srv119017403:85 , srv1193633153:85 , srv1222966313:85 , srv1235840703:85 , srv1249266716:85 , srv1298975546:85 , srv1333896448:85 , srv135817546:85 , srv1377971425:85 , srv1442447242:85 , srv1475794399:85 , srv1520070984:85 , srv16657119:85 , srv1716532182:85 , srv1865220465:85 , srv1952028979:85 , srv2017075571:85 , srv2025110693:85 , srv267613522:85 , srv330562573:85 , srv345613039:85 , srv492011520:85 , srv568473763:85 , srv652521025:85 , srv757099655:85 , srv841978073:85 , srv918040438:85 , srv969235441:85 , srv1033188874:86 , srv1073178495:86 , srv1113258792:86 , srv1214509444:86 , srv1248399307:86 , srv126526815:86 , srv1394872450:86 , srv1472545220:86 , srv157306299:86 , srv1574654928:86 , srv1695293354:86 , srv1697485273:86 , srv1740727677:86 , srv1747792359:86 , srv1871219245:86 , srv1911711192:86 , srv347824426:86 , srv366889619:86 , srv367367578:86 , srv417045670:86 , srv530692184:86 , srv778357981:86 , srv883103878:86 , srv1004208943:87 , srv1110258101:87 , srv1235432221:87 , srv1406754320:87 , srv1524778057:87 , srv1713045396:87 , srv1756095947:87 , srv1910512086:87 , srv2105291090:87 , srv230100560:87 , srv605790891:87 , srv640063152:87 , srv780402886:87 , srv957815927:87 , srv995375217:87 , srv399992645:88 , srv693946139:88 , srv1386551451:568 }
2023-04-05 12:56:40,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:40,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1475794399=29, srv778357981=88, srv1695293354=38, srv1062718200=2, srv1098724159=4, srv2056684205=53, srv367367578=68, srv366889619=67, srv1386551451=23, srv1618870033=34, srv757099655=87, srv399992645=71, srv2065501274=54, srv1871219245=47, srv394223862=70, srv135817546=21, srv1073178495=3, srv996371796=99, srv1249266716=15, srv441982951=74, srv2017075571=51, srv1193633153=9, srv1406754320=25, srv1747792359=44, srv1235432221=12, srv368218382=69, srv780402886=89, srv235014547=60, srv1235840703=13, srv1620791358=35, srv1865220465=46, srv1333896448=18, srv1353280618=20, srv530692184=78, srv2129511855=57, srv492011520=76, srv822363966=91, srv40066362=72, srv1629854288=36, srv883103878=93, srv1431604755=26, srv652521025=82, srv918040438=94, srv969235441=96, srv841978073=92, srv815167635=90, srv605790891=80, srv157306299=32, srv1004208943=0, srv957815927=95, srv126526815=16, srv1701785373=40, srv330562573=63, srv341577120=64, srv2085184083=55, srv995375217=98, srv1110258101=5, srv1756095947=45, srv693946139=85, srv347824426=66, srv1520070984=30, srv2025110693=52, srv1574654928=33, srv219297980=58, srv1377971425=22, srv1350377401=19, srv1394872450=24, srv1472545220=28, srv1910512086=48, srv2105291090=56, srv267613522=61, srv1524778057=31, srv1222966313=11, srv1713045396=41, srv710026069=86, srv1298975546=17, srv520662677=77, srv279779001=62, srv671876975=83, srv682909391=84, srv119017403=8, srv1113258792=6, srv640063152=81, srv16657119=37, srv1248399307=14, srv1442447242=27, srv1697485273=39, srv417045670=73, srv345613039=65, srv568473763=79, srv980908774=97, srv1952028979=50, srv1214509444=10, srv230100560=59, srv488898577=75, srv1911711192=49, srv1141598821=7, srv1740727677=43, srv1033188874=1, srv1716532182=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:40,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:40,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 12:56:40,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 12:56:40,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 12:56:40,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 12:56:40,456 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 12:56:40,457 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 12:56:40,458 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 12:56:40,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008129761931077195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008129761931077195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,570 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-05 12:56:40,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.801657167629306E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008129761931077195); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011853956042166141); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008129761931077195); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-05 12:56:40,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 350 ms to try 5000 different iterations.  Found a solution that moves 263 regions; Going from a computed imbalance of 5.801657167629306E-4 to a new imbalance of 2.2412562650633165E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.029222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,823 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1524778057:82 , srv126526815:83 , srv1350377401:83 , srv399992645:83 , srv640063152:83 , srv1004208943:84 , srv1098724159:84 , srv1110258101:84 , srv1113258792:84 , srv1222966313:84 , srv1248399307:84 , srv1377971425:84 , srv1406754320:84 , srv1472545220:84 , srv1475794399:84 , srv1520070984:84 , srv1695293354:84 , srv1697485273:84 , srv1756095947:84 , srv1871219245:84 , srv1910512086:84 , srv2017075571:84 , srv2025110693:84 , srv2129511855:84 , srv230100560:84 , srv330562573:84 , srv347824426:84 , srv366889619:84 , srv368218382:84 , srv40066362:84 , srv417045670:84 , srv441982951:84 , srv488898577:84 , srv530692184:84 , srv605790891:84 , srv693946139:84 , srv757099655:84 , srv778357981:84 , srv780402886:84 , srv996371796:84 , srv1062718200:85 , srv1073178495:85 , srv119017403:85 , srv1193633153:85 , srv1214509444:85 , srv1235432221:85 , srv1249266716:85 , srv1298975546:85 , srv1333896448:85 , srv1353280618:85 , srv135817546:85 , srv1394872450:85 , srv1431604755:85 , srv1442447242:85 , srv157306299:85 , srv1618870033:85 , srv1629854288:85 , srv16657119:85 , srv1701785373:85 , srv1713045396:85 , srv1747792359:85 , srv1911711192:85 , srv1952028979:85 , srv2056684205:85 , srv2105291090:85 , srv219297980:85 , srv267613522:85 , srv279779001:85 , srv341577120:85 , srv345613039:85 , srv492011520:85 , srv520662677:85 , srv568473763:85 , srv671876975:85 , srv710026069:85 , srv822363966:85 , srv841978073:85 , srv918040438:85 , srv957815927:85 , srv980908774:85 , srv995375217:85 , srv1033188874:86 , srv1141598821:86 , srv1235840703:86 , srv1574654928:86 , srv1620791358:86 , srv1716532182:86 , srv1740727677:86 , srv1865220465:86 , srv2065501274:86 , srv2085184083:86 , srv235014547:86 , srv367367578:86 , srv394223862:86 , srv682909391:86 , srv815167635:86 , srv883103878:86 , srv969235441:86 , srv652521025:87 , srv1386551451:612 }
2023-04-05 12:56:40,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:40,827 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1475794399=29, srv778357981=88, srv1695293354=38, srv1062718200=2, srv1098724159=4, srv2056684205=53, srv367367578=68, srv366889619=67, srv1386551451=23, srv1618870033=34, srv757099655=87, srv399992645=71, srv2065501274=54, srv1871219245=47, srv394223862=70, srv135817546=21, srv1073178495=3, srv996371796=99, srv1249266716=15, srv441982951=74, srv2017075571=51, srv1193633153=9, srv1406754320=25, srv1747792359=44, srv1235432221=12, srv368218382=69, srv780402886=89, srv235014547=60, srv1235840703=13, srv1620791358=35, srv1865220465=46, srv1333896448=18, srv1353280618=20, srv530692184=78, srv2129511855=57, srv492011520=76, srv822363966=91, srv40066362=72, srv1629854288=36, srv883103878=93, srv1431604755=26, srv652521025=82, srv918040438=94, srv969235441=96, srv841978073=92, srv815167635=90, srv605790891=80, srv157306299=32, srv1004208943=0, srv957815927=95, srv126526815=16, srv1701785373=40, srv330562573=63, srv341577120=64, srv2085184083=55, srv995375217=98, srv1110258101=5, srv1756095947=45, srv693946139=85, srv347824426=66, srv1520070984=30, srv2025110693=52, srv1574654928=33, srv219297980=58, srv1377971425=22, srv1350377401=19, srv1394872450=24, srv1472545220=28, srv1910512086=48, srv2105291090=56, srv267613522=61, srv1524778057=31, srv1222966313=11, srv1713045396=41, srv710026069=86, srv1298975546=17, srv520662677=77, srv279779001=62, srv671876975=83, srv682909391=84, srv119017403=8, srv1113258792=6, srv640063152=81, srv16657119=37, srv1248399307=14, srv1442447242=27, srv1697485273=39, srv417045670=73, srv345613039=65, srv568473763=79, srv980908774=97, srv1952028979=50, srv1214509444=10, srv230100560=59, srv488898577=75, srv1911711192=49, srv1141598821=7, srv1740727677=43, srv1033188874=1, srv1716532182=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:40,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:40,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-05 12:56:40,840 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-05 12:56:40,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-05 12:56:40,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-05 12:56:40,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-05 12:56:40,947 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=2.057099729006747E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023688968483956715); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:40,947 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1524778057:82 , srv126526815:83 , srv1350377401:83 , srv399992645:83 , srv640063152:83 , srv1004208943:84 , srv1098724159:84 , srv1110258101:84 , srv1113258792:84 , srv1222966313:84 , srv1248399307:84 , srv1377971425:84 , srv1406754320:84 , srv1472545220:84 , srv1475794399:84 , srv1520070984:84 , srv1695293354:84 , srv1697485273:84 , srv1756095947:84 , srv1871219245:84 , srv1910512086:84 , srv2017075571:84 , srv2025110693:84 , srv2129511855:84 , srv230100560:84 , srv330562573:84 , srv347824426:84 , srv366889619:84 , srv368218382:84 , srv40066362:84 , srv417045670:84 , srv441982951:84 , srv488898577:84 , srv530692184:84 , srv605790891:84 , srv693946139:84 , srv757099655:84 , srv778357981:84 , srv780402886:84 , srv996371796:84 , srv1062718200:85 , srv1073178495:85 , srv119017403:85 , srv1193633153:85 , srv1214509444:85 , srv1235432221:85 , srv1249266716:85 , srv1298975546:85 , srv1333896448:85 , srv1353280618:85 , srv135817546:85 , srv1394872450:85 , srv1431604755:85 , srv1442447242:85 , srv157306299:85 , srv1618870033:85 , srv1629854288:85 , srv16657119:85 , srv1701785373:85 , srv1713045396:85 , srv1747792359:85 , srv1911711192:85 , srv1952028979:85 , srv2056684205:85 , srv2105291090:85 , srv219297980:85 , srv267613522:85 , srv279779001:85 , srv341577120:85 , srv345613039:85 , srv492011520:85 , srv520662677:85 , srv568473763:85 , srv671876975:85 , srv710026069:85 , srv822363966:85 , srv841978073:85 , srv918040438:85 , srv957815927:85 , srv980908774:85 , srv995375217:85 , srv1033188874:86 , srv1141598821:86 , srv1235840703:86 , srv1574654928:86 , srv1620791358:86 , srv1716532182:86 , srv1740727677:86 , srv1865220465:86 , srv2065501274:86 , srv2085184083:86 , srv235014547:86 , srv367367578:86 , srv394223862:86 , srv682909391:86 , srv815167635:86 , srv883103878:86 , srv969235441:86 , srv652521025:87 , srv1386551451:612 }
2023-04-05 12:56:40,970 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=426 (was 426), ProcessCount=169 (was 169), AvailableMemoryMB=1575 (was 2055)
2023-04-05 12:56:40,977 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=426, ProcessCount=169, AvailableMemoryMB=1575
2023-04-05 12:56:40,978 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-05 12:56:40,978 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-05 12:56:40,990 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1021109436:84 , srv1036663620:84 , srv1037032728:84 , srv1276328316:84 , srv1384351795:84 , srv1405833655:84 , srv1444553798:84 , srv148535007:84 , srv1539465308:84 , srv1548840089:84 , srv1736181968:84 , srv1742041734:84 , srv1804677414:84 , srv1978474650:84 , srv2043368718:84 , srv2089253119:84 , srv2098748533:84 , srv261918663:84 , srv305296610:84 , srv387736330:84 , srv388628872:84 , srv435024915:84 , srv438520096:84 , srv645155109:84 , srv766135818:84 , srv808270750:84 , srv85189679:84 , srv919894329:84 , srv945722223:84 , srv715965940:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-05 12:56:40,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:56:40,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435024915=21, srv1804677414=12, srv1736181968=10, srv766135818=25, srv387736330=19, srv715965940=24, srv1742041734=11, srv148535007=7, srv305296610=18, srv1276328316=3, srv2089253119=15, srv261918663=17, srv1384351795=4, srv438520096=22, srv1021109436=0, srv645155109=23, srv1539465308=8, srv1548840089=9, srv1978474650=13, srv945722223=29, srv808270750=26, srv1037032728=2, srv2098748533=16, srv85189679=27, srv1444553798=6, srv1036663620=1, srv1405833655=5, srv919894329=28, srv388628872=20, srv2043368718=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:56:41,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:56:41,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 12:56:41,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1063824266530093, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:56:41,036 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912528250816958, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1063824266530093, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-05 12:58:41,012 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6593762 different iterations.  Found a solution that moves 1864 regions; Going from a computed imbalance of 0.9912528250816958 to a new imbalance of 4.3506689887128686E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6903703703703704, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:58:41,020 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1021109436:90 , srv1036663620:90 , srv1037032728:90 , srv1276328316:90 , srv1384351795:90 , srv1405833655:90 , srv1444553798:90 , srv148535007:90 , srv1539465308:90 , srv1548840089:90 , srv1736181968:90 , srv1742041734:90 , srv1804677414:90 , srv1978474650:90 , srv2043368718:90 , srv2089253119:90 , srv2098748533:90 , srv261918663:90 , srv305296610:90 , srv387736330:90 , srv388628872:90 , srv435024915:90 , srv438520096:90 , srv645155109:90 , srv715965940:90 , srv766135818:90 , srv808270750:90 , srv85189679:90 , srv919894329:90 , srv945722223:90 }
2023-04-05 12:58:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-05 12:58:41,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv435024915=21, srv1804677414=12, srv1736181968=10, srv766135818=25, srv387736330=19, srv715965940=24, srv1742041734=11, srv148535007=7, srv305296610=18, srv1276328316=3, srv2089253119=15, srv261918663=17, srv1384351795=4, srv438520096=22, srv1021109436=0, srv645155109=23, srv1539465308=8, srv1548840089=9, srv1978474650=13, srv945722223=29, srv808270750=26, srv1037032728=2, srv2098748533=16, srv85189679=27, srv1444553798=6, srv1036663620=1, srv1405833655=5, srv919894329=28, srv388628872=20, srv2043368718=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-05 12:58:41,027 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-05 12:58:41,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-05 12:58:41,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-05 12:58:41,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-05 12:58:41,045 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1021109436:90 , srv1036663620:90 , srv1037032728:90 , srv1276328316:90 , srv1384351795:90 , srv1405833655:90 , srv1444553798:90 , srv148535007:90 , srv1539465308:90 , srv1548840089:90 , srv1736181968:90 , srv1742041734:90 , srv1804677414:90 , srv1978474650:90 , srv2043368718:90 , srv2089253119:90 , srv2098748533:90 , srv261918663:90 , srv305296610:90 , srv387736330:90 , srv388628872:90 , srv435024915:90 , srv438520096:90 , srv645155109:90 , srv715965940:90 , srv766135818:90 , srv808270750:90 , srv85189679:90 , srv919894329:90 , srv945722223:90 }
2023-04-05 12:58:41,057 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 426), ProcessCount=169 (was 169), AvailableMemoryMB=1634 (was 1575) - AvailableMemoryMB LEAK? -