2023-10-24 00:55:13,076 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-10-24 00:55:13,313 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-10-24 00:55:13,399 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-10-24 00:55:13,465 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 00:55:13,473 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 00:55:13,487 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=170, AvailableMemoryMB=4502
2023-10-24 00:55:13,490 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 00:55:13,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-10-24 00:55:13,619 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001881913:84 , srv1030929643:84 , srv105276710:84 , srv1066866875:84 , srv1103589413:84 , srv1133115899:84 , srv1147653892:84 , srv1245898882:84 , srv1247382956:84 , srv1251138154:84 , srv1256695263:84 , srv1334001032:84 , srv1344394190:84 , srv1348645688:84 , srv137630024:84 , srv1386511116:84 , srv1402611825:84 , srv1440434948:84 , srv1453892580:84 , srv1465744107:84 , srv1468803000:84 , srv1473932865:84 , srv1499687896:84 , srv1517223885:84 , srv1531113226:84 , srv1542103043:84 , srv1544211083:84 , srv1580736805:84 , srv1585686456:84 , srv1596975871:84 , srv1602749428:84 , srv1605919848:84 , srv1605980348:84 , srv1648643503:84 , srv1659523975:84 , srv1674442814:84 , srv1689403681:84 , srv1720600665:84 , srv1748595170:84 , srv1755025028:84 , srv1764329365:84 , srv1806419149:84 , srv18220340:84 , srv18319670:84 , srv1841272438:84 , srv1861969548:84 , srv1864700445:84 , srv1987656496:84 , srv1990892892:84 , srv1999323517:84 , srv19993861:84 , srv2008011784:84 , srv2011203662:84 , srv2018881026:84 , srv2037121027:84 , srv2057368670:84 , srv2078168966:84 , srv2144962743:84 , srv227766761:84 , srv245620776:84 , srv295380004:84 , srv296455381:84 , srv315004502:84 , srv333709256:84 , srv347800070:84 , srv364968632:84 , srv375968355:84 , srv378642651:84 , srv416885378:84 , srv427573263:84 , srv439017335:84 , srv477259797:84 , srv479730702:84 , srv481874183:84 , srv485355974:84 , srv53659767:84 , srv592194733:84 , srv621143547:84 , srv651662077:84 , srv655710075:84 , srv681879647:84 , srv699543133:84 , srv778078340:84 , srv789383898:84 , srv831297229:84 , srv833339679:84 , srv844521041:84 , srv851968793:84 , srv854034888:84 , srv88191023:84 , srv917087511:84 , srv920013847:84 , srv92225908:84 , srv928768624:84 , srv940433514:84 , srv962973343:84 , srv983656644:84 , srv98862887:84 , srv991243033:84 , srv1084666431:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-10-24 00:55:13,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:13,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:13,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:13,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:13,716 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:13,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:13,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:13,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:13,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:13,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:13,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:13,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:13,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:13,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:13,860 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 00:55:13,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 00:55:14,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 423 ms to try 5000 different iterations.  Found a solution that moves 4713 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1793185345595943. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0409398257852741, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05685944629519912, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5236666666666666, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0409398257852741, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:14,210 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1605980348:82 , srv1748595170:82 , srv1806419149:82 , srv1247382956:83 , srv1256695263:83 , srv1861969548:83 , srv1864700445:83 , srv485355974:83 , srv53659767:83 , srv854034888:83 , srv1103589413:84 , srv1133115899:84 , srv1251138154:84 , srv1440434948:84 , srv19993861:84 , srv333709256:84 , srv364968632:84 , srv481874183:84 , srv778078340:84 , srv98862887:84 , srv1066866875:85 , srv1348645688:85 , srv137630024:85 , srv1499687896:85 , srv1689403681:85 , srv1720600665:85 , srv18220340:85 , srv18319670:85 , srv1990892892:85 , srv2037121027:85 , srv227766761:85 , srv295380004:85 , srv375968355:85 , srv378642651:85 , srv592194733:85 , srv831297229:85 , srv851968793:85 , srv88191023:85 , srv1001881913:86 , srv1147653892:86 , srv1386511116:86 , srv1453892580:86 , srv1473932865:86 , srv1544211083:86 , srv1596975871:86 , srv1602749428:86 , srv1648643503:86 , srv1659523975:86 , srv1987656496:86 , srv2018881026:86 , srv2078168966:86 , srv2144962743:86 , srv245620776:86 , srv296455381:86 , srv347800070:86 , srv427573263:86 , srv651662077:86 , srv789383898:86 , srv833339679:86 , srv844521041:86 , srv105276710:87 , srv1542103043:87 , srv1605919848:87 , srv1841272438:87 , srv1999323517:87 , srv2057368670:87 , srv681879647:87 , srv917087511:87 , srv92225908:87 , srv1030929643:88 , srv1245898882:88 , srv1344394190:88 , srv1402611825:88 , srv1465744107:88 , srv1517223885:88 , srv1674442814:88 , srv2008011784:88 , srv2011203662:88 , srv416885378:88 , srv479730702:88 , srv621143547:88 , srv699543133:88 , srv940433514:88 , srv983656644:88 , srv991243033:88 , srv1334001032:89 , srv1468803000:89 , srv1531113226:89 , srv1585686456:89 , srv477259797:89 , srv655710075:89 , srv920013847:89 , srv928768624:89 , srv962973343:90 , srv1755025028:91 , srv1764329365:91 , srv439017335:92 , srv1580736805:94 , srv315004502:96 , srv1084666431:454 }
2023-10-24 00:55:14,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:14,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:14,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:14,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:14,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:14,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:14,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:14,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:14,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:14,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:14,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:14,340 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0409398257852741, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05685944629519912, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0409398257852741, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:14,340 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 00:55:14,341 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17928553342824696, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0409398257852741, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05685944629519912, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0409398257852741, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17466666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23975, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 00:55:14,576 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 317 ms to try 5000 different iterations.  Found a solution that moves 2602 regions; Going from a computed imbalance of 0.17928553342824696 to a new imbalance of 0.013412101812075056. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025203498986098874, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03520343315570759, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2891111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025203498986098874, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:14,588 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1580736805:78 , srv439017335:78 , srv1764329365:80 , srv1334001032:81 , srv315004502:81 , srv1344394190:82 , srv1402611825:82 , srv1531113226:82 , srv1674442814:82 , srv1755025028:82 , srv416885378:82 , srv621143547:82 , srv920013847:82 , srv928768624:82 , srv962973343:82 , srv1030929643:83 , srv105276710:83 , srv1468803000:83 , srv1473932865:83 , srv427573263:83 , srv699543133:83 , srv983656644:83 , srv1147653892:84 , srv1245898882:84 , srv1517223885:84 , srv1542103043:84 , srv1585686456:84 , srv1841272438:84 , srv479730702:84 , srv655710075:84 , srv681879647:84 , srv917087511:84 , srv1066866875:85 , srv137630024:85 , srv1465744107:85 , srv1596975871:85 , srv1648643503:85 , srv1659523975:85 , srv18220340:85 , srv1999323517:85 , srv2008011784:85 , srv2011203662:85 , srv2078168966:85 , srv245620776:85 , srv295380004:85 , srv347800070:85 , srv477259797:85 , srv651662077:85 , srv88191023:85 , srv991243033:85 , srv1103589413:86 , srv1348645688:86 , srv1499687896:86 , srv1605919848:86 , srv18319670:86 , srv1987656496:86 , srv2018881026:86 , srv2037121027:86 , srv227766761:86 , srv296455381:86 , srv333709256:86 , srv364968632:86 , srv375968355:86 , srv378642651:86 , srv481874183:86 , srv789383898:86 , srv844521041:86 , srv851968793:86 , srv92225908:86 , srv1251138154:87 , srv1453892580:87 , srv1602749428:87 , srv1689403681:87 , srv1861969548:87 , srv1990892892:87 , srv19993861:87 , srv2144962743:87 , srv592194733:87 , srv940433514:87 , srv1001881913:88 , srv1256695263:88 , srv1386511116:88 , srv1864700445:88 , srv53659767:88 , srv831297229:88 , srv854034888:88 , srv1133115899:89 , srv1247382956:89 , srv1440434948:89 , srv1544211083:89 , srv1605980348:89 , srv1720600665:89 , srv833339679:89 , srv98862887:89 , srv778078340:90 , srv1748595170:91 , srv1806419149:91 , srv2057368670:91 , srv485355974:92 , srv1084666431:544 }
2023-10-24 00:55:14,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:14,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:14,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:14,619 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:14,620 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:14,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:14,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:14,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:14,624 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:14,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:14,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:14,627 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:14,628 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:14,744 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025203498986098874, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03520343315570759, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025203498986098874, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:14,745 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 00:55:14,745 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013393882218659878, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.025203498986098874, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03520343315570759, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.025203498986098874, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0415, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 00:55:14,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 290 ms to try 5000 different iterations.  Found a solution that moves 940 regions; Going from a computed imbalance of 0.013393882218659878 to a new imbalance of 5.474221690388488E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008792972967811848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010741321242875511); MoveCostFunction : (multiplier=7.0, imbalance=0.10444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008792972967811848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:14,940 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2057368670:80 , srv315004502:81 , srv1544211083:82 , srv477259797:82 , srv778078340:82 , srv940433514:82 , srv1386511116:83 , srv1465744107:83 , srv1720600665:83 , srv2011203662:83 , srv485355974:83 , srv833339679:83 , srv1001881913:84 , srv1602749428:84 , srv1605919848:84 , srv1748595170:84 , srv1755025028:84 , srv655710075:84 , srv831297229:84 , srv92225908:84 , srv962973343:84 , srv1133115899:85 , srv1245898882:85 , srv1247382956:85 , srv1251138154:85 , srv1440434948:85 , srv1453892580:85 , srv1468803000:85 , srv1517223885:85 , srv1531113226:85 , srv1585686456:85 , srv1596975871:85 , srv1689403681:85 , srv1806419149:85 , srv1841272438:85 , srv1987656496:85 , srv1990892892:85 , srv2008011784:85 , srv2144962743:85 , srv245620776:85 , srv479730702:85 , srv53659767:85 , srv681879647:85 , srv789383898:85 , srv98862887:85 , srv991243033:85 , srv1030929643:86 , srv105276710:86 , srv1103589413:86 , srv1256695263:86 , srv1348645688:86 , srv1499687896:86 , srv1542103043:86 , srv1580736805:86 , srv1659523975:86 , srv1764329365:86 , srv18220340:86 , srv18319670:86 , srv1999323517:86 , srv19993861:86 , srv2018881026:86 , srv2078168966:86 , srv295380004:86 , srv347800070:86 , srv375968355:86 , srv378642651:86 , srv592194733:86 , srv844521041:86 , srv851968793:86 , srv854034888:86 , srv917087511:86 , srv983656644:86 , srv1066866875:87 , srv1147653892:87 , srv1344394190:87 , srv137630024:87 , srv1402611825:87 , srv1473932865:87 , srv1648643503:87 , srv1674442814:87 , srv1864700445:87 , srv2037121027:87 , srv227766761:87 , srv296455381:87 , srv621143547:87 , srv651662077:87 , srv699543133:87 , srv88191023:87 , srv920013847:87 , srv928768624:87 , srv1334001032:88 , srv1605980348:88 , srv1861969548:88 , srv333709256:88 , srv364968632:88 , srv416885378:88 , srv427573263:88 , srv439017335:88 , srv481874183:88 , srv1084666431:538 }
2023-10-24 00:55:14,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:14,945 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:14,963 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:14,964 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:14,965 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:14,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:14,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:14,968 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:14,969 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:14,970 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:14,971 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:14,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:14,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:15,082 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008792972967811848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010741321242875511); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008792972967811848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,082 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 00:55:15,083 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.408401483585E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008792972967811848); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.010741321242875511); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.008792972967811848); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0033333333333333335); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 00:55:15,333 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 349 ms to try 5000 different iterations.  Found a solution that moves 244 regions; Going from a computed imbalance of 5.408401483585E-4 to a new imbalance of 2.641504189923784E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.02711111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,334 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1605980348:82 , srv1580736805:83 , srv920013847:83 , srv1001881913:84 , srv1133115899:84 , srv1334001032:84 , srv1440434948:84 , srv1453892580:84 , srv1585686456:84 , srv1605919848:84 , srv1755025028:84 , srv1806419149:84 , srv18319670:84 , srv1861969548:84 , srv1864700445:84 , srv1999323517:84 , srv2008011784:84 , srv2018881026:84 , srv2037121027:84 , srv2057368670:84 , srv2144962743:84 , srv227766761:84 , srv296455381:84 , srv315004502:84 , srv333709256:84 , srv364968632:84 , srv378642651:84 , srv416885378:84 , srv439017335:84 , srv481874183:84 , srv592194733:84 , srv651662077:84 , srv699543133:84 , srv833339679:84 , srv844521041:84 , srv928768624:84 , srv98862887:84 , srv991243033:84 , srv1030929643:85 , srv1066866875:85 , srv1147653892:85 , srv1245898882:85 , srv1247382956:85 , srv1256695263:85 , srv1344394190:85 , srv1348645688:85 , srv137630024:85 , srv1386511116:85 , srv1402611825:85 , srv1468803000:85 , srv1517223885:85 , srv1542103043:85 , srv1544211083:85 , srv1602749428:85 , srv1648643503:85 , srv1659523975:85 , srv1674442814:85 , srv1689403681:85 , srv1720600665:85 , srv1748595170:85 , srv1987656496:85 , srv1990892892:85 , srv19993861:85 , srv2078168966:85 , srv347800070:85 , srv375968355:85 , srv427573263:85 , srv479730702:85 , srv485355974:85 , srv621143547:85 , srv655710075:85 , srv789383898:85 , srv831297229:85 , srv851968793:85 , srv854034888:85 , srv88191023:85 , srv917087511:85 , srv940433514:85 , srv983656644:85 , srv105276710:86 , srv1103589413:86 , srv1251138154:86 , srv1465744107:86 , srv1473932865:86 , srv1499687896:86 , srv1531113226:86 , srv1764329365:86 , srv18220340:86 , srv1841272438:86 , srv2011203662:86 , srv245620776:86 , srv295380004:86 , srv477259797:86 , srv53659767:86 , srv681879647:86 , srv778078340:86 , srv92225908:86 , srv962973343:86 , srv1596975871:87 , srv1084666431:606 }
2023-10-24 00:55:15,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:15,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:15,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:15,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:15,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:15,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:15,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:15,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:15,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:15,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:15,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:15,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:15,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:15,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:15,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,456 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-10-24 00:55:15,456 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.470651738221111E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-10-24 00:55:15,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 257 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 2.470651738221111E-5 to a new imbalance of 6.193128181907117E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,632 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1499687896:83 , srv1596975871:83 , srv1648643503:83 , srv1764329365:83 , srv296455381:83 , srv485355974:83 , srv92225908:83 , srv1001881913:84 , srv1030929643:84 , srv105276710:84 , srv1066866875:84 , srv1103589413:84 , srv1133115899:84 , srv1147653892:84 , srv1245898882:84 , srv1247382956:84 , srv1251138154:84 , srv1256695263:84 , srv1334001032:84 , srv1344394190:84 , srv1348645688:84 , srv137630024:84 , srv1386511116:84 , srv1402611825:84 , srv1440434948:84 , srv1453892580:84 , srv1465744107:84 , srv1468803000:84 , srv1473932865:84 , srv1517223885:84 , srv1531113226:84 , srv1542103043:84 , srv1544211083:84 , srv1585686456:84 , srv1602749428:84 , srv1659523975:84 , srv1674442814:84 , srv1689403681:84 , srv1720600665:84 , srv1748595170:84 , srv1806419149:84 , srv18220340:84 , srv1841272438:84 , srv1861969548:84 , srv1864700445:84 , srv1987656496:84 , srv1990892892:84 , srv1999323517:84 , srv19993861:84 , srv2008011784:84 , srv2011203662:84 , srv2018881026:84 , srv2037121027:84 , srv2057368670:84 , srv2078168966:84 , srv2144962743:84 , srv227766761:84 , srv245620776:84 , srv295380004:84 , srv315004502:84 , srv333709256:84 , srv347800070:84 , srv364968632:84 , srv375968355:84 , srv416885378:84 , srv427573263:84 , srv439017335:84 , srv477259797:84 , srv479730702:84 , srv481874183:84 , srv53659767:84 , srv592194733:84 , srv621143547:84 , srv651662077:84 , srv655710075:84 , srv681879647:84 , srv699543133:84 , srv778078340:84 , srv789383898:84 , srv831297229:84 , srv833339679:84 , srv844521041:84 , srv851968793:84 , srv854034888:84 , srv88191023:84 , srv917087511:84 , srv928768624:84 , srv940433514:84 , srv962973343:84 , srv983656644:84 , srv98862887:84 , srv991243033:84 , srv1580736805:85 , srv1605919848:85 , srv1605980348:85 , srv1755025028:85 , srv18319670:85 , srv378642651:85 , srv920013847:85 , srv1084666431:684 }
2023-10-24 00:55:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv227766761=59, srv928768624=94, srv137630024=15, srv315004502=63, srv1755025028=40, srv53659767=76, srv1748595170=39, srv1473932865=22, srv1596975871=30, srv378642651=68, srv699543133=82, srv105276710=2, srv1465744107=20, srv1084666431=4, srv917087511=91, srv854034888=89, srv1720600665=38, srv1517223885=24, srv1605980348=33, srv1987656496=48, srv1864700445=47, srv333709256=64, srv1542103043=26, srv1602749428=31, srv2018881026=54, srv2078168966=57, srv1344394190=13, srv18220340=43, srv1861969548=46, srv1605919848=32, srv2037121027=55, srv416885378=69, srv962973343=96, srv1990892892=49, srv1674442814=36, srv983656644=97, srv592194733=77, srv485355974=75, srv789383898=84, srv1689403681=37, srv364968632=66, srv1251138154=10, srv481874183=74, srv479730702=73, srv2057368670=56, srv375968355=67, srv1133115899=6, srv2008011784=52, srv1440434948=18, srv92225908=93, srv833339679=86, srv98862887=98, srv1030929643=1, srv778078340=83, srv1999323517=50, srv1245898882=8, srv1648643503=34, srv1764329365=41, srv920013847=92, srv1247382956=9, srv1386511116=16, srv621143547=78, srv1001881913=0, srv655710075=80, srv1841272438=45, srv347800070=65, srv1348645688=14, srv18319670=44, srv1402611825=17, srv1580736805=28, srv2144962743=58, srv1066866875=3, srv1806419149=42, srv681879647=81, srv427573263=70, srv19993861=51, srv1256695263=11, srv1531113226=25, srv1544211083=27, srv651662077=79, srv851968793=88, srv88191023=90, srv1468803000=21, srv991243033=99, srv844521041=87, srv831297229=85, srv296455381=62, srv1585686456=29, srv940433514=95, srv1499687896=23, srv477259797=72, srv1453892580=19, srv1659523975=35, srv1334001032=12, srv1147653892=7, srv1103589413=5, srv2011203662=53, srv439017335=71, srv295380004=61, srv245620776=60} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:15,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-10-24 00:55:15,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-10-24 00:55:15,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-10-24 00:55:15,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-10-24 00:55:15,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-10-24 00:55:15,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-10-24 00:55:15,729 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,729 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1499687896:83 , srv1596975871:83 , srv1648643503:83 , srv1764329365:83 , srv296455381:83 , srv485355974:83 , srv92225908:83 , srv1001881913:84 , srv1030929643:84 , srv105276710:84 , srv1066866875:84 , srv1103589413:84 , srv1133115899:84 , srv1147653892:84 , srv1245898882:84 , srv1247382956:84 , srv1251138154:84 , srv1256695263:84 , srv1334001032:84 , srv1344394190:84 , srv1348645688:84 , srv137630024:84 , srv1386511116:84 , srv1402611825:84 , srv1440434948:84 , srv1453892580:84 , srv1465744107:84 , srv1468803000:84 , srv1473932865:84 , srv1517223885:84 , srv1531113226:84 , srv1542103043:84 , srv1544211083:84 , srv1585686456:84 , srv1602749428:84 , srv1659523975:84 , srv1674442814:84 , srv1689403681:84 , srv1720600665:84 , srv1748595170:84 , srv1806419149:84 , srv18220340:84 , srv1841272438:84 , srv1861969548:84 , srv1864700445:84 , srv1987656496:84 , srv1990892892:84 , srv1999323517:84 , srv19993861:84 , srv2008011784:84 , srv2011203662:84 , srv2018881026:84 , srv2037121027:84 , srv2057368670:84 , srv2078168966:84 , srv2144962743:84 , srv227766761:84 , srv245620776:84 , srv295380004:84 , srv315004502:84 , srv333709256:84 , srv347800070:84 , srv364968632:84 , srv375968355:84 , srv416885378:84 , srv427573263:84 , srv439017335:84 , srv477259797:84 , srv479730702:84 , srv481874183:84 , srv53659767:84 , srv592194733:84 , srv621143547:84 , srv651662077:84 , srv655710075:84 , srv681879647:84 , srv699543133:84 , srv778078340:84 , srv789383898:84 , srv831297229:84 , srv833339679:84 , srv844521041:84 , srv851968793:84 , srv854034888:84 , srv88191023:84 , srv917087511:84 , srv928768624:84 , srv940433514:84 , srv962973343:84 , srv983656644:84 , srv98862887:84 , srv991243033:84 , srv1580736805:85 , srv1605919848:85 , srv1605980348:85 , srv1755025028:85 , srv18319670:85 , srv378642651:85 , srv920013847:85 , srv1084666431:684 }
2023-10-24 00:55:15,751 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=344 (was 344), ProcessCount=168 (was 170), AvailableMemoryMB=4002 (was 4502)
2023-10-24 00:55:15,757 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=168, AvailableMemoryMB=4002
2023-10-24 00:55:15,757 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-10-24 00:55:15,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-10-24 00:55:15,767 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1192719566:84 , srv1301715879:84 , srv1324147919:84 , srv1498912208:84 , srv1502032972:84 , srv1628525267:84 , srv164918058:84 , srv1686446913:84 , srv1933490262:84 , srv1963552180:84 , srv1990623890:84 , srv2070986303:84 , srv2073478974:84 , srv2112166735:84 , srv2138153590:84 , srv250583721:84 , srv260703283:84 , srv276439601:84 , srv406406896:84 , srv441613542:84 , srv531477981:84 , srv560510672:84 , srv581468140:84 , srv602044067:84 , srv722609927:84 , srv740196997:84 , srv887743904:84 , srv96147617:84 , srv990437127:84 , srv1276327282:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-10-24 00:55:15,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:55:15,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv581468140=23, srv1276327282=1, srv2112166735=14, srv1963552180=10, srv740196997=26, srv441613542=20, srv2138153590=15, srv260703283=17, srv406406896=19, srv1990623890=11, srv1502032972=5, srv2073478974=13, srv887743904=27, srv1686446913=8, srv560510672=22, srv1933490262=9, srv602044067=24, srv1628525267=6, srv2070986303=12, srv276439601=18, srv164918058=7, srv1192719566=0, srv1324147919=3, srv531477981=21, srv722609927=25, srv250583721=16, srv990437127=29, srv1301715879=2, srv1498912208=4, srv96147617=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:55:15,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:55:15,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:55:15,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 00:55:15,809 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.095837347886576, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:55:15,809 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912495023618093, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.095837347886576, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-10-24 00:57:15,788 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 9397568 different iterations.  Found a solution that moves 1833 regions; Going from a computed imbalance of 0.9912495023618093 to a new imbalance of 4.278313442226764E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6788888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:57:15,795 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1192719566:90 , srv1276327282:90 , srv1301715879:90 , srv1324147919:90 , srv1498912208:90 , srv1502032972:90 , srv1628525267:90 , srv164918058:90 , srv1686446913:90 , srv1933490262:90 , srv1963552180:90 , srv1990623890:90 , srv2070986303:90 , srv2073478974:90 , srv2112166735:90 , srv2138153590:90 , srv250583721:90 , srv260703283:90 , srv276439601:90 , srv406406896:90 , srv441613542:90 , srv531477981:90 , srv560510672:90 , srv581468140:90 , srv602044067:90 , srv722609927:90 , srv740196997:90 , srv887743904:90 , srv96147617:90 , srv990437127:90 }
2023-10-24 00:57:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-10-24 00:57:15,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv581468140=23, srv1276327282=1, srv2112166735=14, srv1963552180=10, srv740196997=26, srv441613542=20, srv2138153590=15, srv260703283=17, srv406406896=19, srv1990623890=11, srv1502032972=5, srv2073478974=13, srv887743904=27, srv1686446913=8, srv560510672=22, srv1933490262=9, srv602044067=24, srv1628525267=6, srv2070986303=12, srv276439601=18, srv164918058=7, srv1192719566=0, srv1324147919=3, srv531477981=21, srv722609927=25, srv250583721=16, srv990437127=29, srv1301715879=2, srv1498912208=4, srv96147617=28} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-10-24 00:57:15,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-10-24 00:57:15,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-10-24 00:57:15,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-10-24 00:57:15,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-10-24 00:57:15,817 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-10-24 00:57:15,817 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1192719566:90 , srv1276327282:90 , srv1301715879:90 , srv1324147919:90 , srv1498912208:90 , srv1502032972:90 , srv1628525267:90 , srv164918058:90 , srv1686446913:90 , srv1933490262:90 , srv1963552180:90 , srv1990623890:90 , srv2070986303:90 , srv2073478974:90 , srv2112166735:90 , srv2138153590:90 , srv250583721:90 , srv260703283:90 , srv276439601:90 , srv406406896:90 , srv441613542:90 , srv531477981:90 , srv560510672:90 , srv581468140:90 , srv602044067:90 , srv722609927:90 , srv740196997:90 , srv887743904:90 , srv96147617:90 , srv990437127:90 }
2023-10-24 00:57:15,828 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 344), ProcessCount=168 (was 168), AvailableMemoryMB=3683 (was 4002)