2023-11-26 13:53:12,566 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-11-26 13:53:12,882 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-11-26 13:53:13,011 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-11-26 13:53:13,086 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-26 13:53:13,096 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-26 13:53:13,114 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=172, AvailableMemoryMB=9806
2023-11-26 13:53:13,117 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-26 13:53:13,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-11-26 13:53:13,265 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026858176:84 , srv1043650628:84 , srv105049594:84 , srv1072742227:84 , srv1091207777:84 , srv1112626667:84 , srv1115269937:84 , srv1167467783:84 , srv1221537081:84 , srv1233394260:84 , srv1263692699:84 , srv1280838333:84 , srv1290212405:84 , srv1304638988:84 , srv1316277111:84 , srv1326783220:84 , srv1386085546:84 , srv1447086054:84 , srv1463102297:84 , srv1502642290:84 , srv1503002246:84 , srv1505274736:84 , srv1517832488:84 , srv1539120251:84 , srv1545119336:84 , srv1556068851:84 , srv1556887852:84 , srv1587925955:84 , srv1602208326:84 , srv1610369382:84 , srv1641243632:84 , srv1675973271:84 , srv168722891:84 , srv1697431844:84 , srv1739531557:84 , srv1760951047:84 , srv1766335081:84 , srv1777119703:84 , srv1782503878:84 , srv1845052475:84 , srv1865583753:84 , srv188754992:84 , srv1916272346:84 , srv1919432542:84 , srv1928368396:84 , srv1934050699:84 , srv1939939608:84 , srv1969590735:84 , srv1987250545:84 , srv2097901069:84 , srv2101067240:84 , srv2106858494:84 , srv2127866626:84 , srv2133979764:84 , srv2138813817:84 , srv236158465:84 , srv250145438:84 , srv275713956:84 , srv286592182:84 , srv294244664:84 , srv308938239:84 , srv316976625:84 , srv32691783:84 , srv337669413:84 , srv339978062:84 , srv356541729:84 , srv373704172:84 , srv38845202:84 , srv397618118:84 , srv409823353:84 , srv413455165:84 , srv448394873:84 , srv450223087:84 , srv452396740:84 , srv458285013:84 , srv480929985:84 , srv553352466:84 , srv563386961:84 , srv596634918:84 , srv620906627:84 , srv632977530:84 , srv640360674:84 , srv686391780:84 , srv687021455:84 , srv714942653:84 , srv715318953:84 , srv77039713:84 , srv772307605:84 , srv780878137:84 , srv809410743:84 , srv812127049:84 , srv815883284:84 , srv871647820:84 , srv871803622:84 , srv878014881:84 , srv913903882:84 , srv923259400:84 , srv957001536:84 , srv982953219:84 , srv986423654:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-11-26 13:53:13,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:13,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:13,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:13,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:13,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:13,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:13,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:13,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:13,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:13,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:13,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:13,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:13,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:13,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:13,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:13,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:13,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:13,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:13,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:13,601 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-26 13:53:13,601 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-26 13:53:14,079 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 645 ms to try 5000 different iterations.  Found a solution that moves 4665 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18266772858888827. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03822081275296477, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05721364062354949, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5183333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03822081275296477, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:14,111 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv923259400:81 , srv1026858176:82 , srv1043650628:82 , srv339978062:82 , srv632977530:82 , srv105049594:83 , srv1112626667:83 , srv1556068851:83 , srv1766335081:83 , srv1782503878:83 , srv1934050699:83 , srv286592182:83 , srv871647820:83 , srv1233394260:84 , srv1304638988:84 , srv1316277111:84 , srv1845052475:84 , srv1919432542:84 , srv1987250545:84 , srv356541729:84 , srv38845202:84 , srv553352466:84 , srv982953219:84 , srv1091207777:85 , srv1221537081:85 , srv1505274736:85 , srv1545119336:85 , srv1641243632:85 , srv2138813817:85 , srv294244664:85 , srv308938239:85 , srv337669413:85 , srv409823353:85 , srv413455165:85 , srv452396740:85 , srv458285013:85 , srv686391780:85 , srv714942653:85 , srv77039713:85 , srv809410743:85 , srv1517832488:86 , srv1739531557:86 , srv1777119703:86 , srv1969590735:86 , srv2097901069:86 , srv2101067240:86 , srv2133979764:86 , srv397618118:86 , srv596634918:86 , srv715318953:86 , srv772307605:86 , srv815883284:86 , srv871803622:86 , srv913903882:86 , srv1326783220:87 , srv1463102297:87 , srv1502642290:87 , srv1539120251:87 , srv1556887852:87 , srv1602208326:87 , srv1760951047:87 , srv1928368396:87 , srv1939939608:87 , srv450223087:87 , srv480929985:87 , srv640360674:87 , srv780878137:87 , srv812127049:87 , srv878014881:87 , srv957001536:87 , srv1167467783:88 , srv1503002246:88 , srv1610369382:88 , srv188754992:88 , srv1916272346:88 , srv2106858494:88 , srv32691783:88 , srv563386961:88 , srv687021455:88 , srv1115269937:89 , srv1290212405:89 , srv1447086054:89 , srv2127866626:89 , srv316976625:89 , srv373704172:89 , srv1386085546:90 , srv1675973271:90 , srv1697431844:90 , srv1865583753:90 , srv275713956:90 , srv1263692699:91 , srv1280838333:91 , srv1587925955:91 , srv168722891:91 , srv250145438:91 , srv1072742227:92 , srv448394873:93 , srv236158465:95 , srv620906627:106 , srv986423654:429 }
2023-11-26 13:53:14,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:14,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:14,142 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:14,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:14,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:14,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:14,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:14,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:14,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:14,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:14,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:14,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:14,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:14,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:14,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:14,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:14,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03822081275296477, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05721364062354949, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03822081275296477, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:14,322 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-26 13:53:14,323 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18263506356072465, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03822081275296477, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05721364062354949, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03822081275296477, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.178, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24375, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-26 13:53:14,624 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 436 ms to try 5000 different iterations.  Found a solution that moves 2661 regions; Going from a computed imbalance of 0.18263506356072465 to a new imbalance of 0.015303581298431932. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02227099025881243); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0384491735282517, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2956666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02227099025881243); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:14,636 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv620906627:67 , srv236158465:79 , srv448394873:79 , srv1280838333:80 , srv250145438:80 , srv275713956:80 , srv1072742227:81 , srv1263692699:81 , srv1587925955:81 , srv1675973271:81 , srv188754992:81 , srv1115269937:82 , srv1447086054:82 , srv168722891:82 , srv2106858494:82 , srv316976625:82 , srv1386085546:83 , srv1539120251:83 , srv1610369382:83 , srv32691783:83 , srv1167467783:84 , srv1290212405:84 , srv1502642290:84 , srv1503002246:84 , srv1760951047:84 , srv1865583753:84 , srv1916272346:84 , srv1939939608:84 , srv1969590735:84 , srv373704172:84 , srv397618118:84 , srv450223087:84 , srv480929985:84 , srv780878137:84 , srv1517832488:85 , srv1545119336:85 , srv1556887852:85 , srv1641243632:85 , srv1697431844:85 , srv2101067240:85 , srv2127866626:85 , srv458285013:85 , srv563386961:85 , srv640360674:85 , srv715318953:85 , srv815883284:85 , srv878014881:85 , srv957001536:85 , srv1091207777:86 , srv1326783220:86 , srv1463102297:86 , srv2097901069:86 , srv2133979764:86 , srv413455165:86 , srv452396740:86 , srv686391780:86 , srv687021455:86 , srv812127049:86 , srv871803622:86 , srv913903882:86 , srv105049594:87 , srv1221537081:87 , srv1304638988:87 , srv1602208326:87 , srv1739531557:87 , srv1777119703:87 , srv1919432542:87 , srv1928368396:87 , srv2138813817:87 , srv356541729:87 , srv409823353:87 , srv596634918:87 , srv714942653:87 , srv77039713:87 , srv772307605:87 , srv1112626667:88 , srv1316277111:88 , srv1845052475:88 , srv1987250545:88 , srv286592182:88 , srv294244664:88 , srv308938239:88 , srv337669413:88 , srv553352466:88 , srv809410743:88 , srv1026858176:89 , srv1233394260:89 , srv1556068851:89 , srv1766335081:89 , srv632977530:89 , srv871647820:89 , srv1505274736:90 , srv1782503878:90 , srv339978062:90 , srv38845202:90 , srv982953219:90 , srv1043650628:91 , srv1934050699:91 , srv923259400:96 , srv986423654:543 }
2023-11-26 13:53:14,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:14,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:14,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:14,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:14,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02227099025881243); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0384491735282517, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02227099025881243); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:14,817 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-26 13:53:14,818 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015284948578186816, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02227099025881243); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0384491735282517, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02227099025881243); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.045, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-26 13:53:15,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 519 ms to try 5000 different iterations.  Found a solution that moves 981 regions; Going from a computed imbalance of 0.015284948578186816 to a new imbalance of 5.297755345933643E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.109, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:15,214 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv923259400:81 , srv1934050699:82 , srv1505274736:83 , srv1865583753:83 , srv2127866626:83 , srv38845202:83 , srv563386961:83 , srv687021455:83 , srv982953219:83 , srv1233394260:84 , srv1290212405:84 , srv1602208326:84 , srv168722891:84 , srv1739531557:84 , srv1777119703:84 , srv1782503878:84 , srv1928368396:84 , srv236158465:84 , srv294244664:84 , srv308938239:84 , srv337669413:84 , srv373704172:84 , srv620906627:84 , srv772307605:84 , srv809410743:84 , srv1043650628:85 , srv1072742227:85 , srv1167467783:85 , srv1326783220:85 , srv1386085546:85 , srv1463102297:85 , srv1556068851:85 , srv1556887852:85 , srv1587925955:85 , srv1697431844:85 , srv1766335081:85 , srv1845052475:85 , srv1987250545:85 , srv2133979764:85 , srv2138813817:85 , srv596634918:85 , srv714942653:85 , srv812127049:85 , srv871647820:85 , srv871803622:85 , srv913903882:85 , srv1112626667:86 , srv1263692699:86 , srv1304638988:86 , srv1316277111:86 , srv1447086054:86 , srv1502642290:86 , srv1503002246:86 , srv1517832488:86 , srv1610369382:86 , srv1675973271:86 , srv1916272346:86 , srv2097901069:86 , srv2101067240:86 , srv250145438:86 , srv339978062:86 , srv409823353:86 , srv413455165:86 , srv448394873:86 , srv480929985:86 , srv553352466:86 , srv640360674:86 , srv77039713:86 , srv815883284:86 , srv878014881:86 , srv957001536:86 , srv1026858176:87 , srv1115269937:87 , srv1221537081:87 , srv1280838333:87 , srv1545119336:87 , srv1939939608:87 , srv2106858494:87 , srv275713956:87 , srv286592182:87 , srv316976625:87 , srv32691783:87 , srv356541729:87 , srv450223087:87 , srv452396740:87 , srv458285013:87 , srv632977530:87 , srv686391780:87 , srv715318953:87 , srv780878137:87 , srv105049594:88 , srv1091207777:88 , srv1539120251:88 , srv1641243632:88 , srv1760951047:88 , srv1919432542:88 , srv1969590735:88 , srv397618118:88 , srv188754992:89 , srv986423654:531 }
2023-11-26 13:53:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:15,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:15,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:15,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:15,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:15,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:15,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:15,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:15,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:15,361 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-26 13:53:15,362 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.229064257769576E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005102759975884884); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009039134271190744); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005102759975884884); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-26 13:53:15,785 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 218 regions; Going from a computed imbalance of 5.229064257769576E-4 to a new imbalance of 2.8991431060194044E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.02422222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:15,787 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1091207777:83 , srv1221537081:83 , srv1326783220:83 , srv1697431844:83 , srv1760951047:83 , srv1919432542:83 , srv812127049:83 , srv1043650628:84 , srv105049594:84 , srv1072742227:84 , srv1115269937:84 , srv1263692699:84 , srv1280838333:84 , srv1290212405:84 , srv1316277111:84 , srv1386085546:84 , srv1463102297:84 , srv1503002246:84 , srv1505274736:84 , srv1539120251:84 , srv1641243632:84 , srv1766335081:84 , srv1845052475:84 , srv188754992:84 , srv1928368396:84 , srv1939939608:84 , srv1969590735:84 , srv2097901069:84 , srv236158465:84 , srv286592182:84 , srv32691783:84 , srv339978062:84 , srv356541729:84 , srv397618118:84 , srv409823353:84 , srv448394873:84 , srv450223087:84 , srv452396740:84 , srv553352466:84 , srv596634918:84 , srv632977530:84 , srv640360674:84 , srv686391780:84 , srv715318953:84 , srv77039713:84 , srv772307605:84 , srv809410743:84 , srv878014881:84 , srv923259400:84 , srv957001536:84 , srv1026858176:85 , srv1112626667:85 , srv1167467783:85 , srv1233394260:85 , srv1304638988:85 , srv1447086054:85 , srv1502642290:85 , srv1517832488:85 , srv1556068851:85 , srv1556887852:85 , srv1587925955:85 , srv1602208326:85 , srv1610369382:85 , srv1675973271:85 , srv168722891:85 , srv1739531557:85 , srv1777119703:85 , srv1782503878:85 , srv1865583753:85 , srv1916272346:85 , srv1987250545:85 , srv2101067240:85 , srv2106858494:85 , srv2127866626:85 , srv2133979764:85 , srv2138813817:85 , srv250145438:85 , srv275713956:85 , srv294244664:85 , srv308938239:85 , srv316976625:85 , srv337669413:85 , srv373704172:85 , srv38845202:85 , srv413455165:85 , srv458285013:85 , srv480929985:85 , srv620906627:85 , srv687021455:85 , srv714942653:85 , srv780878137:85 , srv815883284:85 , srv871647820:85 , srv871803622:85 , srv913903882:85 , srv982953219:85 , srv1545119336:86 , srv1934050699:86 , srv563386961:86 , srv986423654:639 }
2023-11-26 13:53:15,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:15,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:15,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:15,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:15,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:15,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:15,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:15,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:15,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:15,819 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:15,820 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:15,821 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:15,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:15,927 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-11-26 13:53:15,927 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7464962434325906E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0023210354127426377); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-11-26 13:53:16,263 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 433 ms to try 5000 different iterations.  Found a solution that moves 27 regions; Going from a computed imbalance of 2.7464962434325906E-5 to a new imbalance of 7.262297337147979E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:16,264 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026858176:83 , srv1545119336:83 , srv1602208326:83 , srv1697431844:83 , srv1916272346:83 , srv316976625:83 , srv780878137:83 , srv1043650628:84 , srv105049594:84 , srv1072742227:84 , srv1091207777:84 , srv1112626667:84 , srv1115269937:84 , srv1167467783:84 , srv1221537081:84 , srv1233394260:84 , srv1263692699:84 , srv1280838333:84 , srv1304638988:84 , srv1316277111:84 , srv1386085546:84 , srv1447086054:84 , srv1463102297:84 , srv1502642290:84 , srv1503002246:84 , srv1505274736:84 , srv1517832488:84 , srv1539120251:84 , srv1556068851:84 , srv1556887852:84 , srv1587925955:84 , srv1610369382:84 , srv1641243632:84 , srv1675973271:84 , srv168722891:84 , srv1739531557:84 , srv1760951047:84 , srv1777119703:84 , srv1782503878:84 , srv1865583753:84 , srv188754992:84 , srv1919432542:84 , srv1928368396:84 , srv1934050699:84 , srv1939939608:84 , srv1969590735:84 , srv1987250545:84 , srv2097901069:84 , srv2101067240:84 , srv2106858494:84 , srv2127866626:84 , srv2133979764:84 , srv2138813817:84 , srv236158465:84 , srv250145438:84 , srv275713956:84 , srv286592182:84 , srv294244664:84 , srv308938239:84 , srv32691783:84 , srv337669413:84 , srv339978062:84 , srv356541729:84 , srv373704172:84 , srv38845202:84 , srv397618118:84 , srv409823353:84 , srv413455165:84 , srv448394873:84 , srv450223087:84 , srv452396740:84 , srv458285013:84 , srv480929985:84 , srv553352466:84 , srv563386961:84 , srv596634918:84 , srv620906627:84 , srv632977530:84 , srv640360674:84 , srv686391780:84 , srv687021455:84 , srv714942653:84 , srv715318953:84 , srv77039713:84 , srv815883284:84 , srv871647820:84 , srv871803622:84 , srv878014881:84 , srv913903882:84 , srv923259400:84 , srv957001536:84 , srv982953219:84 , srv1290212405:85 , srv1326783220:85 , srv1766335081:85 , srv1845052475:85 , srv772307605:85 , srv809410743:85 , srv812127049:85 , srv986423654:684 }
2023-11-26 13:53:16,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:16,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv413455165=70, srv640360674=81, srv553352466=76, srv337669413=63, srv1502642290=19, srv409823353=69, srv815883284=91, srv1556068851=25, srv2127866626=52, srv1233394260=9, srv1934050699=45, srv871647820=92, srv1675973271=31, srv458285013=74, srv1919432542=43, srv923259400=96, srv1539120251=23, srv632977530=80, srv1865583753=40, srv1969590735=47, srv480929985=75, srv1739531557=34, srv812127049=90, srv188754992=41, srv986423654=99, srv982953219=98, srv1304638988=13, srv2101067240=50, srv38845202=67, srv596634918=78, srv1545119336=24, srv809410743=89, srv275713956=57, srv1463102297=18, srv452396740=73, srv871803622=93, srv250145438=56, srv1112626667=5, srv620906627=79, srv1263692699=10, srv339978062=64, srv1766335081=36, srv1782503878=38, srv397618118=68, srv1505274736=21, srv1326783220=15, srv1928368396=44, srv1760951047=35, srv563386961=77, srv687021455=83, srv1587925955=27, srv1290212405=12, srv1610369382=29, srv316976625=61, srv450223087=72, srv1777119703=37, srv1987250545=48, srv1517832488=22, srv373704172=66, srv2106858494=51, srv2133979764=53, srv686391780=82, srv448394873=71, srv1043650628=1, srv1641243632=30, srv878014881=94, srv168722891=32, srv1221537081=8, srv1503002246=20, srv2138813817=54, srv1602208326=28, srv356541729=65, srv1939939608=46, srv1072742227=3, srv77039713=86, srv957001536=97, srv105049594=2, srv1916272346=42, srv714942653=84, srv913903882=95, srv1026858176=0, srv715318953=85, srv1316277111=14, srv1280838333=11, srv32691783=62, srv1447086054=17, srv2097901069=49, srv780878137=88, srv1091207777=4, srv286592182=58, srv772307605=87, srv1115269937=6, srv1556887852=26, srv294244664=59, srv236158465=55, srv1386085546=16, srv1167467783=7, srv1697431844=33, srv308938239=60, srv1845052475=39} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:16,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:16,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:16,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-11-26 13:53:16,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-11-26 13:53:16,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-11-26 13:53:16,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-11-26 13:53:16,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-11-26 13:53:16,393 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:16,393 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026858176:83 , srv1545119336:83 , srv1602208326:83 , srv1697431844:83 , srv1916272346:83 , srv316976625:83 , srv780878137:83 , srv1043650628:84 , srv105049594:84 , srv1072742227:84 , srv1091207777:84 , srv1112626667:84 , srv1115269937:84 , srv1167467783:84 , srv1221537081:84 , srv1233394260:84 , srv1263692699:84 , srv1280838333:84 , srv1304638988:84 , srv1316277111:84 , srv1386085546:84 , srv1447086054:84 , srv1463102297:84 , srv1502642290:84 , srv1503002246:84 , srv1505274736:84 , srv1517832488:84 , srv1539120251:84 , srv1556068851:84 , srv1556887852:84 , srv1587925955:84 , srv1610369382:84 , srv1641243632:84 , srv1675973271:84 , srv168722891:84 , srv1739531557:84 , srv1760951047:84 , srv1777119703:84 , srv1782503878:84 , srv1865583753:84 , srv188754992:84 , srv1919432542:84 , srv1928368396:84 , srv1934050699:84 , srv1939939608:84 , srv1969590735:84 , srv1987250545:84 , srv2097901069:84 , srv2101067240:84 , srv2106858494:84 , srv2127866626:84 , srv2133979764:84 , srv2138813817:84 , srv236158465:84 , srv250145438:84 , srv275713956:84 , srv286592182:84 , srv294244664:84 , srv308938239:84 , srv32691783:84 , srv337669413:84 , srv339978062:84 , srv356541729:84 , srv373704172:84 , srv38845202:84 , srv397618118:84 , srv409823353:84 , srv413455165:84 , srv448394873:84 , srv450223087:84 , srv452396740:84 , srv458285013:84 , srv480929985:84 , srv553352466:84 , srv563386961:84 , srv596634918:84 , srv620906627:84 , srv632977530:84 , srv640360674:84 , srv686391780:84 , srv687021455:84 , srv714942653:84 , srv715318953:84 , srv77039713:84 , srv815883284:84 , srv871647820:84 , srv871803622:84 , srv878014881:84 , srv913903882:84 , srv923259400:84 , srv957001536:84 , srv982953219:84 , srv1290212405:85 , srv1326783220:85 , srv1766335081:85 , srv1845052475:85 , srv772307605:85 , srv809410743:85 , srv812127049:85 , srv986423654:684 }
2023-11-26 13:53:16,430 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=336 (was 305) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=8860 (was 9806)
2023-11-26 13:53:16,443 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=336, ProcessCount=172, AvailableMemoryMB=8858
2023-11-26 13:53:16,444 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-11-26 13:53:16,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-11-26 13:53:16,466 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1023065004:84 , srv1045345132:84 , srv1076161026:84 , srv1157370580:84 , srv1340864813:84 , srv141277222:84 , srv1413895582:84 , srv1487367024:84 , srv1493267801:84 , srv1575253175:84 , srv1663868523:84 , srv1669482277:84 , srv1699850862:84 , srv1724437822:84 , srv1770994457:84 , srv1932413332:84 , srv2080473441:84 , srv2088468406:84 , srv297610351:84 , srv33530115:84 , srv359340871:84 , srv39394609:84 , srv538238131:84 , srv636978671:84 , srv658648533:84 , srv699140711:84 , srv704212723:84 , srv826778643:84 , srv933584483:84 , srv2127720758:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-11-26 13:53:16,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:53:16,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1575253175=9, srv2088468406=17, srv538238131=23, srv1669482277=11, srv1770994457=14, srv1663868523=10, srv1413895582=6, srv33530115=20, srv39394609=22, srv2080473441=16, srv1157370580=3, srv1045345132=1, srv658648533=25, srv1076161026=2, srv1340864813=4, srv704212723=27, srv1023065004=0, srv1493267801=8, srv1699850862=12, srv699140711=26, srv141277222=5, srv933584483=29, srv2127720758=18, srv297610351=19, srv1724437822=13, srv636978671=24, srv826778643=28, srv1932413332=15, srv1487367024=7, srv359340871=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:53:16,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:53:16,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:53:16,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:53:16,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:53:16,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:53:16,488 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-26 13:53:16,514 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1288031850913152, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:53:16,514 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912598897894691, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1288031850913152, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-11-26 13:55:16,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5428744 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.9912598897894691 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:55:16,501 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1023065004:90 , srv1045345132:90 , srv1076161026:90 , srv1157370580:90 , srv1340864813:90 , srv141277222:90 , srv1413895582:90 , srv1487367024:90 , srv1493267801:90 , srv1575253175:90 , srv1663868523:90 , srv1669482277:90 , srv1699850862:90 , srv1724437822:90 , srv1770994457:90 , srv1932413332:90 , srv2080473441:90 , srv2088468406:90 , srv2127720758:90 , srv297610351:90 , srv33530115:90 , srv359340871:90 , srv39394609:90 , srv538238131:90 , srv636978671:90 , srv658648533:90 , srv699140711:90 , srv704212723:90 , srv826778643:90 , srv933584483:90 }
2023-11-26 13:55:16,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-11-26 13:55:16,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1575253175=9, srv2088468406=17, srv538238131=23, srv1669482277=11, srv1770994457=14, srv1663868523=10, srv1413895582=6, srv33530115=20, srv39394609=22, srv2080473441=16, srv1157370580=3, srv1045345132=1, srv658648533=25, srv1076161026=2, srv1340864813=4, srv704212723=27, srv1023065004=0, srv1493267801=8, srv1699850862=12, srv699140711=26, srv141277222=5, srv933584483=29, srv2127720758=18, srv297610351=19, srv1724437822=13, srv636978671=24, srv826778643=28, srv1932413332=15, srv1487367024=7, srv359340871=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-11-26 13:55:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-11-26 13:55:16,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-11-26 13:55:16,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-11-26 13:55:16,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-11-26 13:55:16,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-11-26 13:55:16,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-11-26 13:55:16,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-11-26 13:55:16,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-11-26 13:55:16,524 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-11-26 13:55:16,525 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1023065004:90 , srv1045345132:90 , srv1076161026:90 , srv1157370580:90 , srv1340864813:90 , srv141277222:90 , srv1413895582:90 , srv1487367024:90 , srv1493267801:90 , srv1575253175:90 , srv1663868523:90 , srv1669482277:90 , srv1699850862:90 , srv1724437822:90 , srv1770994457:90 , srv1932413332:90 , srv2080473441:90 , srv2088468406:90 , srv2127720758:90 , srv297610351:90 , srv33530115:90 , srv359340871:90 , srv39394609:90 , srv538238131:90 , srv636978671:90 , srv658648533:90 , srv699140711:90 , srv704212723:90 , srv826778643:90 , srv933584483:90 }
2023-11-26 13:55:16,539 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=158 (was 336), ProcessCount=168 (was 172), AvailableMemoryMB=8275 (was 8858)