2023-05-22 12:21:29,818 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-22 12:21:30,069 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-22 12:21:30,163 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-22 12:21:30,213 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 12:21:30,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-22 12:21:30,233 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=120, ProcessCount=165, AvailableMemoryMB=6494
2023-05-22 12:21:30,235 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 12:21:30,235 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-22 12:21:30,369 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003196482:84 , srv1014544638:84 , srv1015788297:84 , srv1022939185:84 , srv1050587947:84 , srv1087756075:84 , srv10891032:84 , srv110960100:84 , srv1150243642:84 , srv1154020634:84 , srv1156172760:84 , srv1180650690:84 , srv1189425716:84 , srv1223763082:84 , srv1233358246:84 , srv1269446213:84 , srv1272129006:84 , srv131287313:84 , srv1325377067:84 , srv1335857540:84 , srv13443409:84 , srv136372767:84 , srv1383584937:84 , srv140638502:84 , srv1407803807:84 , srv1454144646:84 , srv1458468488:84 , srv1477220533:84 , srv1504950675:84 , srv151228333:84 , srv1512921253:84 , srv1517161883:84 , srv1534805216:84 , srv1538473258:84 , srv157996721:84 , srv1586294232:84 , srv1669178664:84 , srv1676949547:84 , srv1680022316:84 , srv1687548747:84 , srv1725540677:84 , srv1760586816:84 , srv1764986718:84 , srv1835573474:84 , srv1853889301:84 , srv1868534810:84 , srv1871492600:84 , srv1876683748:84 , srv1908201939:84 , srv190895371:84 , srv1911540245:84 , srv1926449170:84 , srv1942557703:84 , srv1974998108:84 , srv1996624871:84 , srv2019936516:84 , srv2056096902:84 , srv2091674277:84 , srv2143599354:84 , srv258009484:84 , srv272014157:84 , srv294580598:84 , srv303426177:84 , srv303837577:84 , srv312628631:84 , srv32747796:84 , srv329127957:84 , srv355537711:84 , srv409426212:84 , srv415740658:84 , srv503648045:84 , srv532460067:84 , srv547882543:84 , srv553702:84 , srv554351211:84 , srv605334433:84 , srv618272259:84 , srv62396971:84 , srv62405560:84 , srv628705623:84 , srv723513933:84 , srv723532357:84 , srv723705103:84 , srv742050294:84 , srv754551731:84 , srv765615010:84 , srv769346239:84 , srv772355394:84 , srv785136200:84 , srv790407024:84 , srv796154039:84 , srv796441701:84 , srv809106735:84 , srv85627034:84 , srv863632568:84 , srv865832737:84 , srv869769330:84 , srv873775463:84 , srv965791021:84 , srv1030486961:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-22 12:21:30,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:30,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:30,441 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:30,442 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:30,443 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:30,444 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:30,445 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:30,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:30,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:30,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:30,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:30,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:30,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:30,574 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 12:21:30,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 12:21:31,008 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 4708 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17619409823307267. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04083154862984821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05954371961386477, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5231111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04083154862984821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,020 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1458468488:80 , srv1504950675:81 , srv1942557703:81 , srv312628631:81 , srv1272129006:82 , srv140638502:82 , srv785136200:82 , srv1477220533:83 , srv151228333:83 , srv1586294232:83 , srv32747796:83 , srv415740658:83 , srv1335857540:84 , srv13443409:84 , srv1407803807:84 , srv723513933:84 , srv723705103:84 , srv754551731:84 , srv769346239:84 , srv1022939185:85 , srv1050587947:85 , srv157996721:85 , srv1760586816:85 , srv1853889301:85 , srv1871492600:85 , srv190895371:85 , srv1911540245:85 , srv258009484:85 , srv409426212:85 , srv863632568:85 , srv865832737:85 , srv1087756075:86 , srv110960100:86 , srv1150243642:86 , srv1233358246:86 , srv136372767:86 , srv1680022316:86 , srv1687548747:86 , srv1868534810:86 , srv2143599354:86 , srv303837577:86 , srv329127957:86 , srv503648045:86 , srv532460067:86 , srv605334433:86 , srv618272259:86 , srv742050294:86 , srv772355394:86 , srv796154039:86 , srv796441701:86 , srv869769330:86 , srv1015788297:87 , srv10891032:87 , srv1269446213:87 , srv1325377067:87 , srv1383584937:87 , srv1517161883:87 , srv1534805216:87 , srv1669178664:87 , srv1676949547:87 , srv1764986718:87 , srv1835573474:87 , srv1876683748:87 , srv1908201939:87 , srv272014157:87 , srv303426177:87 , srv355537711:87 , srv547882543:87 , srv554351211:87 , srv723532357:87 , srv765615010:87 , srv790407024:87 , srv809106735:87 , srv85627034:87 , srv1156172760:88 , srv1189425716:88 , srv131287313:88 , srv2019936516:88 , srv294580598:88 , srv62405560:88 , srv628705623:88 , srv873775463:88 , srv1154020634:89 , srv1180650690:89 , srv1512921253:89 , srv1725540677:89 , srv1996624871:89 , srv2091674277:89 , srv553702:89 , srv62396971:89 , srv965791021:89 , srv1014544638:90 , srv1538473258:90 , srv1926449170:90 , srv2056096902:90 , srv1454144646:91 , srv1003196482:92 , srv1223763082:92 , srv1974998108:94 , srv1030486961:453 }
2023-05-22 12:21:31,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:31,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:31,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:31,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:31,038 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:31,039 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:31,040 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:31,041 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:31,042 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:31,043 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:31,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:31,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:31,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:31,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04083154862984821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05954371961386477, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04083154862984821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,148 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 12:21:31,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1761611321124736, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04083154862984821, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05954371961386477, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04083154862984821, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.171, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24158333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 12:21:31,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 267 ms to try 5000 different iterations.  Found a solution that moves 2650 regions; Going from a computed imbalance of 0.1761611321124736 to a new imbalance of 0.013481902953475093. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022834439939214038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039836929102457855, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022834439939214038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,347 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1223763082:76 , srv1003196482:78 , srv1974998108:79 , srv1454144646:81 , srv1538473258:81 , srv2056096902:81 , srv1180650690:82 , srv1676949547:82 , srv1764986718:82 , srv1926449170:82 , srv553702:82 , srv62396971:82 , srv628705623:82 , srv965791021:82 , srv1015788297:83 , srv1154020634:83 , srv1996624871:83 , srv85627034:83 , srv1087756075:84 , srv1383584937:84 , srv1725540677:84 , srv2019936516:84 , srv272014157:84 , srv329127957:84 , srv772355394:84 , srv809106735:84 , srv1014544638:85 , srv1050587947:85 , srv10891032:85 , srv1189425716:85 , srv1233358246:85 , srv1269446213:85 , srv131287313:85 , srv1534805216:85 , srv1669178664:85 , srv1868534810:85 , srv2091674277:85 , srv294580598:85 , srv303837577:85 , srv355537711:85 , srv503648045:85 , srv547882543:85 , srv554351211:85 , srv618272259:85 , srv62405560:85 , srv790407024:85 , srv796154039:85 , srv796441701:85 , srv869769330:85 , srv873775463:85 , srv1156172760:86 , srv1325377067:86 , srv136372767:86 , srv1517161883:86 , srv1680022316:86 , srv1687548747:86 , srv1853889301:86 , srv1871492600:86 , srv1908201939:86 , srv2143599354:86 , srv258009484:86 , srv532460067:86 , srv723532357:86 , srv863632568:86 , srv1022939185:87 , srv110960100:87 , srv1150243642:87 , srv13443409:87 , srv157996721:87 , srv1835573474:87 , srv1876683748:87 , srv303426177:87 , srv409426212:87 , srv605334433:87 , srv765615010:87 , srv769346239:87 , srv1335857540:88 , srv1407803807:88 , srv1512921253:88 , srv1760586816:88 , srv190895371:88 , srv1911540245:88 , srv415740658:88 , srv723513933:88 , srv723705103:88 , srv742050294:88 , srv754551731:88 , srv865832737:88 , srv151228333:89 , srv32747796:89 , srv140638502:90 , srv1477220533:90 , srv1504950675:90 , srv312628631:90 , srv1272129006:91 , srv1942557703:91 , srv1458468488:92 , srv1586294232:92 , srv785136200:92 , srv1030486961:524 }
2023-05-22 12:21:31,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:31,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:31,368 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:31,369 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:31,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:31,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:31,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:31,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:31,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:31,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:31,461 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022834439939214038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039836929102457855, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022834439939214038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,461 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 12:21:31,461 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013463347256876236, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022834439939214038); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039836929102457855, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022834439939214038); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0455, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 12:21:31,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 230 ms to try 5000 different iterations.  Found a solution that moves 970 regions; Going from a computed imbalance of 0.013463347256876236 to a new imbalance of 8.422039704827622E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00891130730756809); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012721659817307456); MoveCostFunction : (multiplier=7.0, imbalance=0.10777777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00891130730756809); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,621 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1512921253:79 , srv1014544638:82 , srv1586294232:82 , srv765615010:82 , srv1189425716:83 , srv1835573474:83 , srv2091674277:83 , srv303426177:83 , srv1022939185:84 , srv110960100:84 , srv1156172760:84 , srv1269446213:84 , srv1272129006:84 , srv1325377067:84 , srv1335857540:84 , srv1477220533:84 , srv1517161883:84 , srv1725540677:84 , srv1876683748:84 , srv1911540245:84 , srv2143599354:84 , srv32747796:84 , srv409426212:84 , srv554351211:84 , srv605334433:84 , srv723532357:84 , srv742050294:84 , srv785136200:84 , srv865832737:84 , srv1154020634:85 , srv131287313:85 , srv136372767:85 , srv1383584937:85 , srv140638502:85 , srv1454144646:85 , srv1458468488:85 , srv1534805216:85 , srv1538473258:85 , srv1669178664:85 , srv1760586816:85 , srv1853889301:85 , srv1871492600:85 , srv1908201939:85 , srv190895371:85 , srv1974998108:85 , srv1996624871:85 , srv2019936516:85 , srv294580598:85 , srv355537711:85 , srv415740658:85 , srv532460067:85 , srv547882543:85 , srv553702:85 , srv62405560:85 , srv754551731:85 , srv790407024:85 , srv863632568:85 , srv873775463:85 , srv1003196482:86 , srv10891032:86 , srv1150243642:86 , srv1180650690:86 , srv1233358246:86 , srv1407803807:86 , srv1504950675:86 , srv151228333:86 , srv157996721:86 , srv1680022316:86 , srv1687548747:86 , srv1926449170:86 , srv1942557703:86 , srv2056096902:86 , srv303837577:86 , srv503648045:86 , srv62396971:86 , srv723513933:86 , srv723705103:86 , srv769346239:86 , srv796154039:86 , srv809106735:86 , srv869769330:86 , srv1015788297:87 , srv1087756075:87 , srv1868534810:87 , srv258009484:87 , srv272014157:87 , srv329127957:87 , srv618272259:87 , srv628705623:87 , srv772355394:87 , srv796441701:87 , srv85627034:87 , srv965791021:87 , srv1676949547:88 , srv312628631:88 , srv1050587947:89 , srv1223763082:89 , srv13443409:89 , srv1764986718:89 , srv1030486961:560 }
2023-05-22 12:21:31,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:31,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:31,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:31,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:31,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:31,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:31,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:31,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:31,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:31,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:31,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:31,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:31,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00891130730756809); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012721659817307456); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00891130730756809); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,725 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 12:21:31,726 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.354118853126149E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00891130730756809); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.012721659817307456); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00891130730756809); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004833333333333334); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 12:21:31,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 273 ms to try 5000 different iterations.  Found a solution that moves 298 regions; Going from a computed imbalance of 8.354118853126149E-4 to a new imbalance of 4.317099188943041E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.03311111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:31,928 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv13443409:82 , srv1050587947:83 , srv1150243642:83 , srv1687548747:83 , srv1760586816:83 , srv312628631:83 , srv796441701:83 , srv10891032:84 , srv110960100:84 , srv1156172760:84 , srv131287313:84 , srv151228333:84 , srv1586294232:84 , srv1676949547:84 , srv1680022316:84 , srv1764986718:84 , srv1868534810:84 , srv1876683748:84 , srv1908201939:84 , srv190895371:84 , srv1926449170:84 , srv1942557703:84 , srv1974998108:84 , srv258009484:84 , srv272014157:84 , srv294580598:84 , srv532460067:84 , srv618272259:84 , srv723513933:84 , srv723705103:84 , srv742050294:84 , srv772355394:84 , srv785136200:84 , srv865832737:84 , srv873775463:84 , srv965791021:84 , srv1014544638:85 , srv1015788297:85 , srv1154020634:85 , srv1180650690:85 , srv1233358246:85 , srv1272129006:85 , srv1325377067:85 , srv136372767:85 , srv140638502:85 , srv1407803807:85 , srv1458468488:85 , srv1477220533:85 , srv1504950675:85 , srv1517161883:85 , srv1534805216:85 , srv157996721:85 , srv1669178664:85 , srv1725540677:85 , srv1835573474:85 , srv1911540245:85 , srv1996624871:85 , srv2019936516:85 , srv2056096902:85 , srv2091674277:85 , srv303426177:85 , srv303837577:85 , srv329127957:85 , srv355537711:85 , srv503648045:85 , srv547882543:85 , srv605334433:85 , srv62396971:85 , srv62405560:85 , srv628705623:85 , srv723532357:85 , srv754551731:85 , srv769346239:85 , srv790407024:85 , srv796154039:85 , srv809106735:85 , srv85627034:85 , srv869769330:85 , srv1003196482:86 , srv1022939185:86 , srv1087756075:86 , srv1189425716:86 , srv1223763082:86 , srv1269446213:86 , srv1335857540:86 , srv1383584937:86 , srv1454144646:86 , srv1512921253:86 , srv1538473258:86 , srv1853889301:86 , srv1871492600:86 , srv2143599354:86 , srv553702:86 , srv554351211:86 , srv765615010:86 , srv863632568:86 , srv32747796:87 , srv409426212:87 , srv415740658:87 , srv1030486961:605 }
2023-05-22 12:21:31,931 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:31,932 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:31,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:31,946 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:31,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:31,948 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:31,949 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:31,950 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:31,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:31,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:31,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:31,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:31,955 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:32,030 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:32,030 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-22 12:21:32,031 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.108435129076662E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-22 12:21:32,167 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 205 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 4.108435129076662E-5 to a new imbalance of 7.27630163646787E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:32,167 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1087756075:83 , srv1223763082:83 , srv1407803807:83 , srv1454144646:83 , srv157996721:83 , srv32747796:83 , srv409426212:83 , srv415740658:83 , srv62405560:83 , srv1003196482:84 , srv1014544638:84 , srv1015788297:84 , srv1022939185:84 , srv1050587947:84 , srv10891032:84 , srv1150243642:84 , srv1154020634:84 , srv1156172760:84 , srv1180650690:84 , srv1189425716:84 , srv1233358246:84 , srv1269446213:84 , srv1272129006:84 , srv131287313:84 , srv1325377067:84 , srv1335857540:84 , srv13443409:84 , srv136372767:84 , srv1383584937:84 , srv140638502:84 , srv1458468488:84 , srv1477220533:84 , srv1504950675:84 , srv151228333:84 , srv1512921253:84 , srv1517161883:84 , srv1534805216:84 , srv1538473258:84 , srv1669178664:84 , srv1680022316:84 , srv1725540677:84 , srv1764986718:84 , srv1835573474:84 , srv1853889301:84 , srv1868534810:84 , srv1871492600:84 , srv1876683748:84 , srv1908201939:84 , srv190895371:84 , srv1911540245:84 , srv1926449170:84 , srv1942557703:84 , srv1974998108:84 , srv1996624871:84 , srv2019936516:84 , srv2056096902:84 , srv2091674277:84 , srv2143599354:84 , srv258009484:84 , srv272014157:84 , srv294580598:84 , srv303426177:84 , srv303837577:84 , srv312628631:84 , srv329127957:84 , srv355537711:84 , srv503648045:84 , srv547882543:84 , srv553702:84 , srv554351211:84 , srv605334433:84 , srv618272259:84 , srv62396971:84 , srv628705623:84 , srv723513933:84 , srv723532357:84 , srv723705103:84 , srv742050294:84 , srv754551731:84 , srv765615010:84 , srv769346239:84 , srv785136200:84 , srv790407024:84 , srv796154039:84 , srv809106735:84 , srv85627034:84 , srv863632568:84 , srv869769330:84 , srv873775463:84 , srv965791021:84 , srv110960100:85 , srv1586294232:85 , srv1676949547:85 , srv1687548747:85 , srv1760586816:85 , srv532460067:85 , srv772355394:85 , srv796441701:85 , srv865832737:85 , srv1030486961:684 }
2023-05-22 12:21:32,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:32,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1030486961=4, srv1504950675=29, srv796154039=91, srv1586294232=36, srv2056096902=57, srv1876683748=48, srv85627034=94, srv1974998108=54, srv1050587947=5, srv1407803807=25, srv1458468488=27, srv605334433=76, srv1512921253=31, srv140638502=24, srv10891032=7, srv329127957=67, srv1669178664=37, srv312628631=65, srv553702=74, srv754551731=85, srv1383584937=23, srv415740658=70, srv157996721=35, srv796441701=92, srv1154020634=10, srv1014544638=1, srv1180650690=12, srv1942557703=53, srv303837577=64, srv1764986718=43, srv1676949547=38, srv131287313=18, srv723705103=83, srv628705623=80, srv62396971=78, srv863632568=95, srv1003196482=0, srv136372767=22, srv1760586816=42, srv769346239=87, srv1015788297=2, srv1908201939=49, srv62405560=79, srv110960100=8, srv1156172760=11, srv1272129006=17, srv1680022316=39, srv1269446213=16, srv618272259=77, srv1868534810=46, srv723532357=82, srv1233358246=15, srv1996624871=55, srv2143599354=59, srv1150243642=9, srv742050294=84, srv865832737=96, srv355537711=68, srv765615010=86, srv1911540245=51, srv294580598=62, srv1835573474=44, srv785136200=89, srv1022939185=3, srv809106735=93, srv2091674277=58, srv258009484=60, srv1454144646=26, srv1853889301=45, srv790407024=90, srv409426212=69, srv1335857540=20, srv772355394=88, srv503648045=71, srv1325377067=19, srv723513933=81, srv1477220533=28, srv1725540677=41, srv532460067=72, srv873775463=98, srv2019936516=56, srv1871492600=47, srv32747796=66, srv1517161883=32, srv869769330=97, srv1087756075=6, srv190895371=50, srv965791021=99, srv1223763082=14, srv13443409=21, srv151228333=30, srv1538473258=34, srv303426177=63, srv554351211=75, srv1926449170=52, srv1189425716=13, srv547882543=73, srv1687548747=40, srv1534805216=33, srv272014157=61} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:32,180 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:32,181 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:32,182 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-22 12:21:32,183 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-22 12:21:32,184 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-22 12:21:32,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-22 12:21:32,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-22 12:21:32,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-22 12:21:32,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-22 12:21:32,189 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-22 12:21:32,265 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:32,265 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1087756075:83 , srv1223763082:83 , srv1407803807:83 , srv1454144646:83 , srv157996721:83 , srv32747796:83 , srv409426212:83 , srv415740658:83 , srv62405560:83 , srv1003196482:84 , srv1014544638:84 , srv1015788297:84 , srv1022939185:84 , srv1050587947:84 , srv10891032:84 , srv1150243642:84 , srv1154020634:84 , srv1156172760:84 , srv1180650690:84 , srv1189425716:84 , srv1233358246:84 , srv1269446213:84 , srv1272129006:84 , srv131287313:84 , srv1325377067:84 , srv1335857540:84 , srv13443409:84 , srv136372767:84 , srv1383584937:84 , srv140638502:84 , srv1458468488:84 , srv1477220533:84 , srv1504950675:84 , srv151228333:84 , srv1512921253:84 , srv1517161883:84 , srv1534805216:84 , srv1538473258:84 , srv1669178664:84 , srv1680022316:84 , srv1725540677:84 , srv1764986718:84 , srv1835573474:84 , srv1853889301:84 , srv1868534810:84 , srv1871492600:84 , srv1876683748:84 , srv1908201939:84 , srv190895371:84 , srv1911540245:84 , srv1926449170:84 , srv1942557703:84 , srv1974998108:84 , srv1996624871:84 , srv2019936516:84 , srv2056096902:84 , srv2091674277:84 , srv2143599354:84 , srv258009484:84 , srv272014157:84 , srv294580598:84 , srv303426177:84 , srv303837577:84 , srv312628631:84 , srv329127957:84 , srv355537711:84 , srv503648045:84 , srv547882543:84 , srv553702:84 , srv554351211:84 , srv605334433:84 , srv618272259:84 , srv62396971:84 , srv628705623:84 , srv723513933:84 , srv723532357:84 , srv723705103:84 , srv742050294:84 , srv754551731:84 , srv765615010:84 , srv769346239:84 , srv785136200:84 , srv790407024:84 , srv796154039:84 , srv809106735:84 , srv85627034:84 , srv863632568:84 , srv869769330:84 , srv873775463:84 , srv965791021:84 , srv110960100:85 , srv1586294232:85 , srv1676949547:85 , srv1687548747:85 , srv1760586816:85 , srv532460067:85 , srv772355394:85 , srv796441701:85 , srv865832737:85 , srv1030486961:684 }
2023-05-22 12:21:32,290 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 120) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=6006 (was 6494)
2023-05-22 12:21:32,296 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=165, AvailableMemoryMB=6005
2023-05-22 12:21:32,297 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-22 12:21:32,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-22 12:21:32,305 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1187199116:84 , srv1273478295:84 , srv1362109261:84 , srv1437868816:84 , srv1445634178:84 , srv1481307016:84 , srv1539818676:84 , srv1606754372:84 , srv168328281:84 , srv1746778782:84 , srv1784294303:84 , srv1788905608:84 , srv1844870438:84 , srv194243334:84 , srv2067644486:84 , srv2105164534:84 , srv2108607855:84 , srv309624235:84 , srv443102604:84 , srv549089946:84 , srv644885617:84 , srv676209709:84 , srv699934085:84 , srv756466588:84 , srv785550937:84 , srv826779938:84 , srv947527523:84 , srv982649787:84 , srv989176619:84 , srv1244939859:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-22 12:21:32,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:21:32,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1481307016=6, srv1539818676=7, srv1244939859=1, srv644885617=21, srv549089946=20, srv989176619=29, srv1844870438=13, srv676209709=22, srv1746778782=10, srv1788905608=12, srv1784294303=11, srv309624235=18, srv443102604=19, srv947527523=27, srv1606754372=8, srv982649787=28, srv1187199116=0, srv2105164534=16, srv1273478295=2, srv1437868816=4, srv2067644486=15, srv699934085=23, srv756466588=24, srv1362109261=3, srv826779938=26, srv2108607855=17, srv168328281=9, srv785550937=25, srv1445634178=5, srv194243334=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:21:32,313 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:21:32,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-22 12:21:32,327 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1151010671614827, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:21:32,328 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991255572296851, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1151010671614827, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-22 12:23:32,317 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 10891011 different iterations.  Found a solution that moves 1835 regions; Going from a computed imbalance of 0.991255572296851 to a new imbalance of 4.2829815420000605E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6796296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:23:32,324 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1187199116:90 , srv1244939859:90 , srv1273478295:90 , srv1362109261:90 , srv1437868816:90 , srv1445634178:90 , srv1481307016:90 , srv1539818676:90 , srv1606754372:90 , srv168328281:90 , srv1746778782:90 , srv1784294303:90 , srv1788905608:90 , srv1844870438:90 , srv194243334:90 , srv2067644486:90 , srv2105164534:90 , srv2108607855:90 , srv309624235:90 , srv443102604:90 , srv549089946:90 , srv644885617:90 , srv676209709:90 , srv699934085:90 , srv756466588:90 , srv785550937:90 , srv826779938:90 , srv947527523:90 , srv982649787:90 , srv989176619:90 }
2023-05-22 12:23:32,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-22 12:23:32,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1481307016=6, srv1539818676=7, srv1244939859=1, srv644885617=21, srv549089946=20, srv989176619=29, srv1844870438=13, srv676209709=22, srv1746778782=10, srv1788905608=12, srv1784294303=11, srv309624235=18, srv443102604=19, srv947527523=27, srv1606754372=8, srv982649787=28, srv1187199116=0, srv2105164534=16, srv1273478295=2, srv1437868816=4, srv2067644486=15, srv699934085=23, srv756466588=24, srv1362109261=3, srv826779938=26, srv2108607855=17, srv168328281=9, srv785550937=25, srv1445634178=5, srv194243334=14} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-22 12:23:32,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-22 12:23:32,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-22 12:23:32,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-22 12:23:32,340 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1187199116:90 , srv1244939859:90 , srv1273478295:90 , srv1362109261:90 , srv1437868816:90 , srv1445634178:90 , srv1481307016:90 , srv1539818676:90 , srv1606754372:90 , srv168328281:90 , srv1746778782:90 , srv1784294303:90 , srv1788905608:90 , srv1844870438:90 , srv194243334:90 , srv2067644486:90 , srv2105164534:90 , srv2108607855:90 , srv309624235:90 , srv443102604:90 , srv549089946:90 , srv644885617:90 , srv676209709:90 , srv699934085:90 , srv756466588:90 , srv785550937:90 , srv826779938:90 , srv947527523:90 , srv982649787:90 , srv989176619:90 }
2023-05-22 12:23:32,350 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=5884 (was 6005)