2023-12-10 01:56:38,871 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-10 01:56:39,153 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-10 01:56:39,265 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-10 01:56:39,320 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 01:56:39,326 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 01:56:39,338 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=171, AvailableMemoryMB=3063
2023-12-10 01:56:39,340 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 01:56:39,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-10 01:56:39,468 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1011868400:84 , srv1028614058:84 , srv1052513867:84 , srv1077367486:84 , srv1110495028:84 , srv1115719106:84 , srv1129899588:84 , srv1141912836:84 , srv1142287432:84 , srv1155497435:84 , srv11619660:84 , srv1217198475:84 , srv1229190892:84 , srv1277144233:84 , srv1299019253:84 , srv1304258353:84 , srv1317100531:84 , srv1322948280:84 , srv1346376250:84 , srv135559514:84 , srv1385795051:84 , srv1385952040:84 , srv1395672781:84 , srv1483496037:84 , srv150197411:84 , srv1531225556:84 , srv1571859478:84 , srv1609104162:84 , srv163157693:84 , srv1671154825:84 , srv1679373058:84 , srv1725469134:84 , srv1772921158:84 , srv1780675468:84 , srv1789873078:84 , srv1798311874:84 , srv1810136468:84 , srv1855179617:84 , srv1874771585:84 , srv1875107047:84 , srv1903193031:84 , srv1956609586:84 , srv1995606788:84 , srv20192697:84 , srv2025610774:84 , srv2052409595:84 , srv2069359183:84 , srv2084931043:84 , srv2093170047:84 , srv2094052886:84 , srv2119789634:84 , srv2138140006:84 , srv226801870:84 , srv279499287:84 , srv284714012:84 , srv285910142:84 , srv298441281:84 , srv309762082:84 , srv318244517:84 , srv350169295:84 , srv377452154:84 , srv428076365:84 , srv440045948:84 , srv449788177:84 , srv458978878:84 , srv475521506:84 , srv501223234:84 , srv502265666:84 , srv553793360:84 , srv579601614:84 , srv586053297:84 , srv591831987:84 , srv609707600:84 , srv61069125:84 , srv623259815:84 , srv645870067:84 , srv653132946:84 , srv724821855:84 , srv72708124:84 , srv731129238:84 , srv762729580:84 , srv778396265:84 , srv797171112:84 , srv808412936:84 , srv810066752:84 , srv813406553:84 , srv826636168:84 , srv834640667:84 , srv836013539:84 , srv866380948:84 , srv88372071:84 , srv889850449:84 , srv910462508:84 , srv932916493:84 , srv969897016:84 , srv975634467:84 , srv975983049:84 , srv978666043:84 , srv990496923:84 , srv1022347979:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-10 01:56:39,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:39,489 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:39,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:39,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:39,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:39,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:39,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:39,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:39,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:39,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:39,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:39,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:39,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:39,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:39,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:39,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:39,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:39,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:39,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:39,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:39,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:39,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:39,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:39,979 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:39,980 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 01:56:39,980 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 01:56:40,292 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 664 ms to try 5000 different iterations.  Found a solution that moves 4679 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17808928374438654. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04048434779961503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06265004436041041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5198888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04048434779961503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:40,306 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1346376250:81 , srv1874771585:82 , srv135559514:83 , srv1571859478:83 , srv1679373058:83 , srv1855179617:83 , srv309762082:83 , srv440045948:83 , srv731129238:83 , srv910462508:83 , srv1141912836:84 , srv1299019253:84 , srv2119789634:84 , srv226801870:84 , srv318244517:84 , srv428076365:84 , srv501223234:84 , srv724821855:84 , srv969897016:84 , srv1011868400:85 , srv1077367486:85 , srv1217198475:85 , srv1531225556:85 , srv1609104162:85 , srv1671154825:85 , srv1798311874:85 , srv1956609586:85 , srv284714012:85 , srv350169295:85 , srv377452154:85 , srv475521506:85 , srv502265666:85 , srv645870067:85 , srv653132946:85 , srv762729580:85 , srv813406553:85 , srv889850449:85 , srv990496923:85 , srv1115719106:86 , srv1142287432:86 , srv1322948280:86 , srv1385952040:86 , srv1395672781:86 , srv1725469134:86 , srv2052409595:86 , srv2069359183:86 , srv2094052886:86 , srv279499287:86 , srv298441281:86 , srv458978878:86 , srv609707600:86 , srv778396265:86 , srv810066752:86 , srv836013539:86 , srv866380948:86 , srv1028614058:87 , srv1052513867:87 , srv1110495028:87 , srv1129899588:87 , srv1277144233:87 , srv1385795051:87 , srv150197411:87 , srv1772921158:87 , srv20192697:87 , srv2025610774:87 , srv2138140006:87 , srv449788177:87 , srv553793360:87 , srv579601614:87 , srv623259815:87 , srv826636168:87 , srv88372071:87 , srv975634467:87 , srv975983049:87 , srv1229190892:88 , srv1780675468:88 , srv1810136468:88 , srv1903193031:88 , srv2084931043:88 , srv834640667:88 , srv1304258353:89 , srv163157693:89 , srv1789873078:89 , srv1875107047:89 , srv1995606788:89 , srv2093170047:89 , srv285910142:89 , srv586053297:89 , srv591831987:89 , srv808412936:89 , srv1317100531:90 , srv932916493:90 , srv978666043:90 , srv1483496037:91 , srv61069125:91 , srv72708124:91 , srv797171112:91 , srv1155497435:92 , srv11619660:93 , srv1022347979:450 }
2023-12-10 01:56:40,310 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:40,311 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:40,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:40,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:40,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:40,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:40,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:40,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:40,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:40,332 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:40,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:40,334 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:40,335 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:40,336 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:40,337 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:40,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:40,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:40,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04048434779961503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06265004436041041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04048434779961503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:40,456 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 01:56:40,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17805652068612762, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04048434779961503, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06265004436041041, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04048434779961503, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.173, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.2425, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 01:56:40,681 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 313 ms to try 5000 different iterations.  Found a solution that moves 2601 regions; Going from a computed imbalance of 0.17805652068612762 to a new imbalance of 0.013895988007800572. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980891381341088); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03347444877124522, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.289, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980891381341088); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:40,692 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv11619660:79 , srv1155497435:80 , srv1317100531:80 , srv797171112:80 , srv1875107047:81 , srv72708124:81 , srv932916493:81 , srv1483496037:82 , srv61069125:82 , srv1229190892:83 , srv150197411:83 , srv2093170047:83 , srv586053297:83 , srv808412936:83 , srv834640667:83 , srv88372071:83 , srv978666043:83 , srv1110495028:84 , srv1780675468:84 , srv1789873078:84 , srv1995606788:84 , srv2069359183:84 , srv2084931043:84 , srv2094052886:84 , srv279499287:84 , srv285910142:84 , srv449788177:84 , srv591831987:84 , srv866380948:84 , srv1052513867:85 , srv1277144233:85 , srv1322948280:85 , srv1385952040:85 , srv1903193031:85 , srv2025610774:85 , srv579601614:85 , srv609707600:85 , srv623259815:85 , srv653132946:85 , srv1028614058:86 , srv1129899588:86 , srv1299019253:86 , srv1304258353:86 , srv1385795051:86 , srv163157693:86 , srv1772921158:86 , srv1810136468:86 , srv2138140006:86 , srv350169295:86 , srv377452154:86 , srv475521506:86 , srv553793360:86 , srv724821855:86 , srv762729580:86 , srv778396265:86 , srv810066752:86 , srv826636168:86 , srv975634467:86 , srv1395672781:87 , srv1571859478:87 , srv1609104162:87 , srv1725469134:87 , srv1798311874:87 , srv20192697:87 , srv2052409595:87 , srv226801870:87 , srv284714012:87 , srv298441281:87 , srv318244517:87 , srv813406553:87 , srv836013539:87 , srv969897016:87 , srv1011868400:88 , srv1077367486:88 , srv1115719106:88 , srv1142287432:88 , srv1217198475:88 , srv1531225556:88 , srv1671154825:88 , srv428076365:88 , srv458978878:88 , srv501223234:88 , srv502265666:88 , srv889850449:88 , srv910462508:88 , srv975983049:88 , srv990496923:88 , srv1679373058:89 , srv309762082:89 , srv440045948:89 , srv645870067:89 , srv731129238:89 , srv1346376250:90 , srv1855179617:90 , srv1956609586:90 , srv2119789634:90 , srv1141912836:91 , srv135559514:91 , srv1874771585:93 , srv1022347979:500 }
2023-12-10 01:56:40,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:40,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:40,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:40,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:40,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:40,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:40,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:40,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:40,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:40,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:40,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:40,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:40,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:40,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:40,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:40,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:40,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:40,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980891381341088); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03347444877124522, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980891381341088); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:40,826 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 01:56:40,826 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013877775416535053, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01980891381341088); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03347444877124522, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.01980891381341088); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010666666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 01:56:40,998 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 254 ms to try 5000 different iterations.  Found a solution that moves 1025 regions; Going from a computed imbalance of 0.013877775416535053 to a new imbalance of 0.0013355604841447958. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00798427185671495); MoveCostFunction : (multiplier=7.0, imbalance=0.11388888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00575); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,000 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1304258353:82 , srv163157693:82 , srv1956609586:82 , srv1115719106:83 , srv1141912836:83 , srv1810136468:83 , srv1874771585:83 , srv20192697:83 , srv2119789634:83 , srv645870067:83 , srv975983049:83 , srv1011868400:84 , srv1142287432:84 , srv1217198475:84 , srv135559514:84 , srv1385795051:84 , srv1671154825:84 , srv1725469134:84 , srv298441281:84 , srv458978878:84 , srv502265666:84 , srv553793360:84 , srv1028614058:85 , srv1129899588:85 , srv1277144233:85 , srv1395672781:85 , srv1483496037:85 , srv1531225556:85 , srv1609104162:85 , srv1772921158:85 , srv1780675468:85 , srv1789873078:85 , srv1798311874:85 , srv1903193031:85 , srv1995606788:85 , srv2052409595:85 , srv2084931043:85 , srv2138140006:85 , srv285910142:85 , srv428076365:85 , srv440045948:85 , srv579601614:85 , srv586053297:85 , srv591831987:85 , srv778396265:85 , srv826636168:85 , srv836013539:85 , srv889850449:85 , srv910462508:85 , srv932916493:85 , srv975634467:85 , srv978666043:85 , srv990496923:85 , srv1052513867:86 , srv1077367486:86 , srv1110495028:86 , srv1155497435:86 , srv11619660:86 , srv1229190892:86 , srv1346376250:86 , srv1385952040:86 , srv150197411:86 , srv1679373058:86 , srv1855179617:86 , srv2025610774:86 , srv2093170047:86 , srv226801870:86 , srv284714012:86 , srv309762082:86 , srv350169295:86 , srv377452154:86 , srv475521506:86 , srv501223234:86 , srv609707600:86 , srv61069125:86 , srv72708124:86 , srv731129238:86 , srv797171112:86 , srv808412936:86 , srv810066752:86 , srv813406553:86 , srv834640667:86 , srv1299019253:87 , srv1322948280:87 , srv1571859478:87 , srv2069359183:87 , srv2094052886:87 , srv279499287:87 , srv318244517:87 , srv449788177:87 , srv623259815:87 , srv724821855:87 , srv762729580:87 , srv969897016:87 , srv1317100531:88 , srv1875107047:88 , srv653132946:88 , srv866380948:88 , srv88372071:88 , srv1022347979:553 }
2023-12-10 01:56:41,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:41,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:41,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:41,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:41,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:41,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:41,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:41,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:41,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:41,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:41,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00798427185671495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00575); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,122 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 01:56:41,122 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0013283832807433516, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005097869931660642); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00798427185671495); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005097869931660642); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=8.333333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00575); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 01:56:41,357 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 326 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 0.0013283832807433516 to a new imbalance of 2.8978168366263263E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,357 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1142287432:83 , srv1855179617:83 , srv1903193031:83 , srv61069125:83 , srv623259815:83 , srv836013539:83 , srv975983049:83 , srv1028614058:84 , srv1052513867:84 , srv1077367486:84 , srv1110495028:84 , srv1129899588:84 , srv1141912836:84 , srv1155497435:84 , srv11619660:84 , srv1277144233:84 , srv1317100531:84 , srv1322948280:84 , srv135559514:84 , srv1385795051:84 , srv1395672781:84 , srv1531225556:84 , srv163157693:84 , srv1772921158:84 , srv1789873078:84 , srv1874771585:84 , srv1875107047:84 , srv1995606788:84 , srv2025610774:84 , srv2052409595:84 , srv2093170047:84 , srv2138140006:84 , srv284714012:84 , srv285910142:84 , srv298441281:84 , srv309762082:84 , srv318244517:84 , srv449788177:84 , srv458978878:84 , srv501223234:84 , srv591831987:84 , srv653132946:84 , srv731129238:84 , srv762729580:84 , srv808412936:84 , srv810066752:84 , srv813406553:84 , srv826636168:84 , srv866380948:84 , srv889850449:84 , srv969897016:84 , srv975634467:84 , srv990496923:84 , srv1011868400:85 , srv1115719106:85 , srv1217198475:85 , srv1229190892:85 , srv1299019253:85 , srv1304258353:85 , srv1346376250:85 , srv1385952040:85 , srv1483496037:85 , srv1671154825:85 , srv1679373058:85 , srv1725469134:85 , srv1780675468:85 , srv1798311874:85 , srv1810136468:85 , srv1956609586:85 , srv20192697:85 , srv2084931043:85 , srv2094052886:85 , srv2119789634:85 , srv226801870:85 , srv279499287:85 , srv350169295:85 , srv377452154:85 , srv428076365:85 , srv440045948:85 , srv475521506:85 , srv502265666:85 , srv553793360:85 , srv579601614:85 , srv586053297:85 , srv609707600:85 , srv645870067:85 , srv724821855:85 , srv72708124:85 , srv778396265:85 , srv797171112:85 , srv88372071:85 , srv910462508:85 , srv978666043:85 , srv150197411:86 , srv1571859478:86 , srv1609104162:86 , srv2069359183:86 , srv834640667:86 , srv932916493:86 , srv1022347979:639 }
2023-12-10 01:56:41,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:41,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:41,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:41,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:41,370 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:41,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:41,372 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:41,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:41,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:41,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:41,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:41,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:41,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:41,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:41,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:41,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,471 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-10 01:56:41,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.6947544964879038E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002118805753879094); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-10 01:56:41,626 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 238 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 2.6947544964879038E-5 to a new imbalance of 7.885481990829257E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,626 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1077367486:83 , srv1483496037:83 , srv1571859478:83 , srv1609104162:83 , srv1679373058:83 , srv2069359183:83 , srv72708124:83 , srv834640667:83 , srv88372071:83 , srv978666043:83 , srv1011868400:84 , srv1028614058:84 , srv1052513867:84 , srv1115719106:84 , srv1129899588:84 , srv1141912836:84 , srv1155497435:84 , srv11619660:84 , srv1217198475:84 , srv1229190892:84 , srv1299019253:84 , srv1304258353:84 , srv1317100531:84 , srv1322948280:84 , srv1346376250:84 , srv135559514:84 , srv1385952040:84 , srv1395672781:84 , srv150197411:84 , srv1531225556:84 , srv1671154825:84 , srv1725469134:84 , srv1772921158:84 , srv1780675468:84 , srv1789873078:84 , srv1798311874:84 , srv1810136468:84 , srv1855179617:84 , srv1874771585:84 , srv1875107047:84 , srv1956609586:84 , srv1995606788:84 , srv20192697:84 , srv2025610774:84 , srv2052409595:84 , srv2084931043:84 , srv2093170047:84 , srv2094052886:84 , srv2119789634:84 , srv2138140006:84 , srv226801870:84 , srv279499287:84 , srv284714012:84 , srv285910142:84 , srv309762082:84 , srv318244517:84 , srv350169295:84 , srv377452154:84 , srv428076365:84 , srv440045948:84 , srv449788177:84 , srv458978878:84 , srv475521506:84 , srv501223234:84 , srv502265666:84 , srv553793360:84 , srv579601614:84 , srv586053297:84 , srv591831987:84 , srv609707600:84 , srv61069125:84 , srv623259815:84 , srv645870067:84 , srv653132946:84 , srv724821855:84 , srv731129238:84 , srv762729580:84 , srv778396265:84 , srv797171112:84 , srv808412936:84 , srv810066752:84 , srv813406553:84 , srv826636168:84 , srv866380948:84 , srv889850449:84 , srv932916493:84 , srv969897016:84 , srv975634467:84 , srv990496923:84 , srv1110495028:85 , srv1142287432:85 , srv1277144233:85 , srv1385795051:85 , srv163157693:85 , srv1903193031:85 , srv298441281:85 , srv836013539:85 , srv910462508:85 , srv975983049:85 , srv1022347979:684 }
2023-12-10 01:56:41,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:41,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1277144233=14, srv553793360=69, srv2119789634=51, srv284714012=55, srv72708124=79, srv978666043=98, srv1531225556=26, srv762729580=81, srv778396265=82, srv279499287=54, srv645870067=76, srv226801870=53, srv1142287432=9, srv975634467=96, srv932916493=94, srv1155497435=10, srv1141912836=8, srv2069359183=47, srv88372071=91, srv813406553=86, srv1217198475=12, srv1317100531=17, srv502265666=68, srv990496923=99, srv731129238=80, srv1229190892=13, srv1679373058=31, srv1789873078=35, srv135559514=20, srv826636168=87, srv1671154825=30, srv1855179617=38, srv2138140006=52, srv298441281=57, srv1903193031=41, srv61069125=74, srv428076365=62, srv1011868400=0, srv150197411=25, srv1810136468=37, srv579601614=70, srv1129899588=7, srv318244517=59, srv285910142=56, srv475521506=66, srv501223234=67, srv1077367486=4, srv808412936=84, srv1115719106=6, srv653132946=77, srv1609104162=28, srv350169295=60, srv591831987=72, srv1022347979=1, srv1395672781=23, srv1346376250=19, srv810066752=85, srv2052409595=46, srv1110495028=5, srv1299019253=15, srv836013539=89, srv1304258353=16, srv1052513867=3, srv1385952040=22, srv866380948=90, srv1798311874=36, srv377452154=61, srv797171112=83, srv969897016=95, srv449788177=64, srv1875107047=40, srv458978878=65, srv586053297=71, srv724821855=78, srv1725469134=32, srv910462508=93, srv20192697=44, srv1571859478=27, srv1772921158=33, srv1956609586=42, srv1483496037=24, srv2084931043=48, srv1780675468=34, srv609707600=73, srv163157693=29, srv889850449=92, srv1322948280=18, srv1995606788=43, srv440045948=63, srv11619660=11, srv2093170047=49, srv2025610774=45, srv975983049=97, srv834640667=88, srv623259815=75, srv2094052886=50, srv1385795051=21, srv1874771585=39, srv1028614058=2, srv309762082=58} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:41,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:41,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:41,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:41,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:41,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-10 01:56:41,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-10 01:56:41,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-10 01:56:41,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-10 01:56:41,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-10 01:56:41,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-10 01:56:41,747 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,747 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1077367486:83 , srv1483496037:83 , srv1571859478:83 , srv1609104162:83 , srv1679373058:83 , srv2069359183:83 , srv72708124:83 , srv834640667:83 , srv88372071:83 , srv978666043:83 , srv1011868400:84 , srv1028614058:84 , srv1052513867:84 , srv1115719106:84 , srv1129899588:84 , srv1141912836:84 , srv1155497435:84 , srv11619660:84 , srv1217198475:84 , srv1229190892:84 , srv1299019253:84 , srv1304258353:84 , srv1317100531:84 , srv1322948280:84 , srv1346376250:84 , srv135559514:84 , srv1385952040:84 , srv1395672781:84 , srv150197411:84 , srv1531225556:84 , srv1671154825:84 , srv1725469134:84 , srv1772921158:84 , srv1780675468:84 , srv1789873078:84 , srv1798311874:84 , srv1810136468:84 , srv1855179617:84 , srv1874771585:84 , srv1875107047:84 , srv1956609586:84 , srv1995606788:84 , srv20192697:84 , srv2025610774:84 , srv2052409595:84 , srv2084931043:84 , srv2093170047:84 , srv2094052886:84 , srv2119789634:84 , srv2138140006:84 , srv226801870:84 , srv279499287:84 , srv284714012:84 , srv285910142:84 , srv309762082:84 , srv318244517:84 , srv350169295:84 , srv377452154:84 , srv428076365:84 , srv440045948:84 , srv449788177:84 , srv458978878:84 , srv475521506:84 , srv501223234:84 , srv502265666:84 , srv553793360:84 , srv579601614:84 , srv586053297:84 , srv591831987:84 , srv609707600:84 , srv61069125:84 , srv623259815:84 , srv645870067:84 , srv653132946:84 , srv724821855:84 , srv731129238:84 , srv762729580:84 , srv778396265:84 , srv797171112:84 , srv808412936:84 , srv810066752:84 , srv813406553:84 , srv826636168:84 , srv866380948:84 , srv889850449:84 , srv932916493:84 , srv969897016:84 , srv975634467:84 , srv990496923:84 , srv1110495028:85 , srv1142287432:85 , srv1277144233:85 , srv1385795051:85 , srv163157693:85 , srv1903193031:85 , srv298441281:85 , srv836013539:85 , srv910462508:85 , srv975983049:85 , srv1022347979:684 }
2023-12-10 01:56:41,769 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 237), ProcessCount=171 (was 171), AvailableMemoryMB=2540 (was 3063)
2023-12-10 01:56:41,777 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=171, AvailableMemoryMB=2540
2023-12-10 01:56:41,777 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-10 01:56:41,778 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-10 01:56:41,786 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1029454077:84 , srv1046225236:84 , srv1079061811:84 , srv1087741189:84 , srv116761039:84 , srv1174288328:84 , srv1287079118:84 , srv1405325194:84 , srv1426841987:84 , srv1484325986:84 , srv1494230018:84 , srv1521485941:84 , srv1522441874:84 , srv1547308066:84 , srv1567282175:84 , srv157123708:84 , srv1580592782:84 , srv1945072334:84 , srv1992783230:84 , srv261943026:84 , srv361583577:84 , srv473297107:84 , srv521129202:84 , srv716246252:84 , srv775643350:84 , srv776153797:84 , srv92908742:84 , srv941412376:84 , srv946461083:84 , srv531381198:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-10 01:56:41,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:56:41,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1580592782=16, srv716246252=24, srv1174288328=5, srv1287079118=6, srv116761039=4, srv1945072334=17, srv473297107=21, srv946461083=29, srv1992783230=18, srv1087741189=3, srv776153797=26, srv1522441874=12, srv1079061811=2, srv1426841987=8, srv1046225236=1, srv1547308066=13, srv1494230018=10, srv1484325986=9, srv157123708=15, srv531381198=23, srv941412376=28, srv1521485941=11, srv1405325194=7, srv1567282175=14, srv775643350=25, srv361583577=20, srv261943026=19, srv521129202=22, srv1029454077=0, srv92908742=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:56:41,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:56:41,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:56:41,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 01:56:41,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0666836281421281, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:56:41,814 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912403161199136, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0666836281421281, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-10 01:58:41,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9615009 different iterations.  Found a solution that moves 1842 regions; Going from a computed imbalance of 0.9912403161199136 to a new imbalance of 4.2993198912066E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6822222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:58:41,809 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1029454077:90 , srv1046225236:90 , srv1079061811:90 , srv1087741189:90 , srv116761039:90 , srv1174288328:90 , srv1287079118:90 , srv1405325194:90 , srv1426841987:90 , srv1484325986:90 , srv1494230018:90 , srv1521485941:90 , srv1522441874:90 , srv1547308066:90 , srv1567282175:90 , srv157123708:90 , srv1580592782:90 , srv1945072334:90 , srv1992783230:90 , srv261943026:90 , srv361583577:90 , srv473297107:90 , srv521129202:90 , srv531381198:90 , srv716246252:90 , srv775643350:90 , srv776153797:90 , srv92908742:90 , srv941412376:90 , srv946461083:90 }
2023-12-10 01:58:41,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-10 01:58:41,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1580592782=16, srv716246252=24, srv1174288328=5, srv1287079118=6, srv116761039=4, srv1945072334=17, srv473297107=21, srv946461083=29, srv1992783230=18, srv1087741189=3, srv776153797=26, srv1522441874=12, srv1079061811=2, srv1426841987=8, srv1046225236=1, srv1547308066=13, srv1494230018=10, srv1484325986=9, srv157123708=15, srv531381198=23, srv941412376=28, srv1521485941=11, srv1405325194=7, srv1567282175=14, srv775643350=25, srv361583577=20, srv261943026=19, srv521129202=22, srv1029454077=0, srv92908742=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-10 01:58:41,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-10 01:58:41,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-10 01:58:41,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-10 01:58:41,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-10 01:58:41,823 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-10 01:58:41,823 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1029454077:90 , srv1046225236:90 , srv1079061811:90 , srv1087741189:90 , srv116761039:90 , srv1174288328:90 , srv1287079118:90 , srv1405325194:90 , srv1426841987:90 , srv1484325986:90 , srv1494230018:90 , srv1521485941:90 , srv1522441874:90 , srv1547308066:90 , srv1567282175:90 , srv157123708:90 , srv1580592782:90 , srv1945072334:90 , srv1992783230:90 , srv261943026:90 , srv361583577:90 , srv473297107:90 , srv521129202:90 , srv531381198:90 , srv716246252:90 , srv775643350:90 , srv776153797:90 , srv92908742:90 , srv941412376:90 , srv946461083:90 }
2023-12-10 01:58:41,833 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 237), ProcessCount=170 (was 171), AvailableMemoryMB=3572 (was 2540) - AvailableMemoryMB LEAK? -