2023-08-07 03:53:13,082 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-07 03:53:13,405 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-07 03:53:13,518 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-07 03:53:13,590 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 03:53:13,598 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 03:53:13,612 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=173, AvailableMemoryMB=3729
2023-08-07 03:53:13,614 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 03:53:13,614 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-07 03:53:13,763 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1030773978:84 , srv1049009230:84 , srv1068094227:84 , srv1073963817:84 , srv1090894841:84 , srv1099128920:84 , srv1114434742:84 , srv1116870192:84 , srv113851763:84 , srv1150185377:84 , srv1163102538:84 , srv1232971641:84 , srv1250502060:84 , srv1273947309:84 , srv1298948417:84 , srv1305608766:84 , srv1312103399:84 , srv1324456388:84 , srv1376585465:84 , srv138420464:84 , srv1394611371:84 , srv1411236149:84 , srv1421798579:84 , srv1443868449:84 , srv149520820:84 , srv1496383828:84 , srv1512025138:84 , srv1525739570:84 , srv152857161:84 , srv1531640473:84 , srv1556578656:84 , srv1573694475:84 , srv158551307:84 , srv1702195058:84 , srv1703710801:84 , srv1725240398:84 , srv1743417113:84 , srv1821937849:84 , srv1824880618:84 , srv1842107215:84 , srv1897613322:84 , srv1941100259:84 , srv1965777173:84 , srv1981800885:84 , srv2044274688:84 , srv2068219702:84 , srv206882101:84 , srv2105883463:84 , srv2115619160:84 , srv22917501:84 , srv264369213:84 , srv266151439:84 , srv290095929:84 , srv291861430:84 , srv306308566:84 , srv334930092:84 , srv338769486:84 , srv354967403:84 , srv363189148:84 , srv371163284:84 , srv390728352:84 , srv418003209:84 , srv451930697:84 , srv465533815:84 , srv475779873:84 , srv482944707:84 , srv486095141:84 , srv497395116:84 , srv501240169:84 , srv523402292:84 , srv539864457:84 , srv546734369:84 , srv549552763:84 , srv577149074:84 , srv585479012:84 , srv601617637:84 , srv608930534:84 , srv631526773:84 , srv642438488:84 , srv665994819:84 , srv683661863:84 , srv701268085:84 , srv755877894:84 , srv758223848:84 , srv795017197:84 , srv804764090:84 , srv825034684:84 , srv834376225:84 , srv838839328:84 , srv85312602:84 , srv865285176:84 , srv917341370:84 , srv922330163:84 , srv935609702:84 , srv958073492:84 , srv96248258:84 , srv96453047:84 , srv969976647:84 , srv977661992:84 , srv729823153:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-07 03:53:13,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:13,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:13,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:13,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:13,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:13,869 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:13,870 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:13,871 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:13,872 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:13,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:13,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:13,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:13,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:13,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:13,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:14,087 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:14,088 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 03:53:14,088 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 03:53:14,541 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 643 ms to try 5000 different iterations.  Found a solution that moves 4718 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17962515479044186. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03933732154002588, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058349925490216385, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5242222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03933732154002588, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:14,561 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2068219702:80 , srv371163284:80 , srv475779873:80 , srv1073963817:81 , srv1324456388:81 , srv158551307:81 , srv1941100259:81 , srv1049009230:82 , srv113851763:82 , srv1702195058:82 , srv22917501:82 , srv482944707:82 , srv601617637:82 , srv96453047:82 , srv977661992:82 , srv501240169:83 , srv1163102538:84 , srv1273947309:84 , srv1298948417:84 , srv1743417113:84 , srv2115619160:84 , srv290095929:84 , srv390728352:84 , srv549552763:84 , srv683661863:84 , srv758223848:84 , srv838839328:84 , srv1116870192:85 , srv1250502060:85 , srv1411236149:85 , srv1556578656:85 , srv338769486:85 , srv539864457:85 , srv608930534:85 , srv642438488:85 , srv865285176:85 , srv1030773978:86 , srv1394611371:86 , srv1496383828:86 , srv1573694475:86 , srv1897613322:86 , srv418003209:86 , srv585479012:86 , srv665994819:86 , srv834376225:86 , srv917341370:86 , srv958073492:86 , srv1305608766:87 , srv1312103399:87 , srv1443868449:87 , srv1531640473:87 , srv1842107215:87 , srv363189148:87 , srv486095141:87 , srv523402292:87 , srv546734369:87 , srv755877894:87 , srv795017197:87 , srv825034684:87 , srv1232971641:88 , srv1376585465:88 , srv1525739570:88 , srv1725240398:88 , srv1965777173:88 , srv1981800885:88 , srv2044274688:88 , srv264369213:88 , srv291861430:88 , srv306308566:88 , srv334930092:88 , srv354967403:88 , srv497395116:88 , srv577149074:88 , srv935609702:88 , srv969976647:88 , srv1099128920:89 , srv1114434742:89 , srv1150185377:89 , srv1421798579:89 , srv1512025138:89 , srv152857161:89 , srv1703710801:89 , srv2105883463:89 , srv451930697:89 , srv465533815:89 , srv631526773:89 , srv804764090:89 , srv922330163:89 , srv1090894841:90 , srv206882101:90 , srv266151439:90 , srv701268085:90 , srv138420464:91 , srv1821937849:91 , srv149520820:92 , srv96248258:92 , srv85312602:95 , srv1824880618:96 , srv1068094227:97 , srv729823153:439 }
2023-08-07 03:53:14,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:14,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:14,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:14,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:14,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:14,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:14,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:14,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:14,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:14,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:14,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:14,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:14,724 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03933732154002588, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058349925490216385, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03933732154002588, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:14,725 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 03:53:14,725 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17959211864834623, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03933732154002588, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.058349925490216385, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03933732154002588, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1745, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24483333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 03:53:15,104 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 492 ms to try 5000 different iterations.  Found a solution that moves 2611 regions; Going from a computed imbalance of 0.17959211864834623 to a new imbalance of 0.016942850546986736. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2901111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:15,118 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1068094227:75 , srv1824880618:77 , srv149520820:79 , srv1821937849:79 , srv1703710801:80 , srv85312602:80 , srv1090894841:81 , srv138420464:81 , srv206882101:81 , srv701268085:81 , srv96248258:81 , srv1512025138:82 , srv1525739570:82 , srv2044274688:82 , srv497395116:82 , srv1114434742:83 , srv1150185377:83 , srv1305608766:83 , srv1421798579:83 , srv266151439:83 , srv465533815:83 , srv523402292:83 , srv755877894:83 , srv917341370:83 , srv969976647:83 , srv1232971641:84 , srv1394611371:84 , srv1531640473:84 , srv1725240398:84 , srv1842107215:84 , srv1981800885:84 , srv306308566:84 , srv334930092:84 , srv354967403:84 , srv546734369:84 , srv631526773:84 , srv665994819:84 , srv804764090:84 , srv935609702:84 , srv1312103399:85 , srv152857161:85 , srv1573694475:85 , srv264369213:85 , srv291861430:85 , srv338769486:85 , srv363189148:85 , srv549552763:85 , srv577149074:85 , srv825034684:85 , srv834376225:85 , srv922330163:85 , srv1030773978:86 , srv1376585465:86 , srv1443868449:86 , srv1743417113:86 , srv1897613322:86 , srv1965777173:86 , srv2115619160:86 , srv451930697:86 , srv486095141:86 , srv585479012:86 , srv642438488:86 , srv758223848:86 , srv795017197:86 , srv1099128920:87 , srv1273947309:87 , srv1496383828:87 , srv1556578656:87 , srv2105883463:87 , srv608930534:87 , srv1116870192:88 , srv1250502060:88 , srv1298948417:88 , srv1411236149:88 , srv290095929:88 , srv418003209:88 , srv539864457:88 , srv838839328:88 , srv1702195058:89 , srv501240169:89 , srv865285176:89 , srv958073492:89 , srv1049009230:90 , srv113851763:90 , srv1324456388:90 , srv158551307:90 , srv390728352:90 , srv482944707:90 , srv601617637:90 , srv683661863:90 , srv96453047:90 , srv1163102538:91 , srv2068219702:91 , srv22917501:91 , srv977661992:91 , srv1073963817:92 , srv1941100259:92 , srv371163284:93 , srv475779873:93 , srv729823153:527 }
2023-08-07 03:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:15,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:15,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:15,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:15,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:15,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:15,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:15,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:15,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:15,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:15,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:15,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:15,321 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:15,322 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 03:53:15,322 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01692456793422462, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021611703285895137); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03506927567716167, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021611703285895137); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04675, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 03:53:15,618 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 432 ms to try 5000 different iterations.  Found a solution that moves 1036 regions; Going from a computed imbalance of 0.01692456793422462 to a new imbalance of 6.61332366485923E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006559178363224968); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008287754140107479); MoveCostFunction : (multiplier=7.0, imbalance=0.11511111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006559178363224968); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:15,620 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1099128920:81 , srv1163102538:82 , srv2105883463:82 , srv390728352:82 , srv865285176:82 , srv1376585465:83 , srv1965777173:83 , srv451930697:83 , srv85312602:83 , srv922330163:83 , srv1250502060:84 , srv1443868449:84 , srv1496383828:84 , srv152857161:84 , srv1824880618:84 , srv266151439:84 , srv334930092:84 , srv371163284:84 , srv418003209:84 , srv486095141:84 , srv683661863:84 , srv795017197:84 , srv804764090:84 , srv958073492:84 , srv977661992:84 , srv1030773978:85 , srv1049009230:85 , srv1068094227:85 , srv1073963817:85 , srv1116870192:85 , srv1150185377:85 , srv1232971641:85 , srv1298948417:85 , srv1312103399:85 , srv1411236149:85 , srv1556578656:85 , srv1725240398:85 , srv1941100259:85 , srv22917501:85 , srv264369213:85 , srv290095929:85 , srv291861430:85 , srv306308566:85 , srv363189148:85 , srv465533815:85 , srv475779873:85 , srv501240169:85 , srv577149074:85 , srv585479012:85 , srv631526773:85 , srv825034684:85 , srv838839328:85 , srv935609702:85 , srv96248258:85 , srv96453047:85 , srv1090894841:86 , srv1114434742:86 , srv113851763:86 , srv1273947309:86 , srv1324456388:86 , srv138420464:86 , srv1421798579:86 , srv1512025138:86 , srv1842107215:86 , srv1981800885:86 , srv2068219702:86 , srv206882101:86 , srv2115619160:86 , srv354967403:86 , srv482944707:86 , srv523402292:86 , srv539864457:86 , srv546734369:86 , srv601617637:86 , srv608930534:86 , srv642438488:86 , srv755877894:86 , srv834376225:86 , srv1305608766:87 , srv149520820:87 , srv1525739570:87 , srv1531640473:87 , srv158551307:87 , srv1743417113:87 , srv1821937849:87 , srv1897613322:87 , srv497395116:87 , srv665994819:87 , srv701268085:87 , srv969976647:87 , srv1394611371:88 , srv1573694475:88 , srv1702195058:88 , srv1703710801:88 , srv2044274688:88 , srv549552763:88 , srv758223848:88 , srv917341370:88 , srv338769486:90 , srv729823153:550 }
2023-08-07 03:53:15,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:15,625 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:15,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:15,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:15,770 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006559178363224968); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008287754140107479); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006559178363224968); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:15,770 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 03:53:15,771 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.540781394382195E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006559178363224968); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008287754140107479); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006559178363224968); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 03:53:16,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 551 ms to try 5000 different iterations.  Found a solution that moves 245 regions; Going from a computed imbalance of 6.540781394382195E-4 to a new imbalance of 2.7631454112471402E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.02722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:16,209 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv338769486:82 , srv539864457:82 , srv1573694475:83 , srv1702195058:83 , srv1897613322:83 , srv958073492:83 , srv1073963817:84 , srv1114434742:84 , srv1116870192:84 , srv113851763:84 , srv1250502060:84 , srv138420464:84 , srv1411236149:84 , srv1421798579:84 , srv149520820:84 , srv152857161:84 , srv1531640473:84 , srv158551307:84 , srv1703710801:84 , srv1941100259:84 , srv1981800885:84 , srv2044274688:84 , srv2105883463:84 , srv22917501:84 , srv264369213:84 , srv266151439:84 , srv354967403:84 , srv418003209:84 , srv451930697:84 , srv475779873:84 , srv482944707:84 , srv577149074:84 , srv585479012:84 , srv601617637:84 , srv608930534:84 , srv631526773:84 , srv701268085:84 , srv758223848:84 , srv85312602:84 , srv917341370:84 , srv96248258:84 , srv969976647:84 , srv1030773978:85 , srv1049009230:85 , srv1068094227:85 , srv1099128920:85 , srv1150185377:85 , srv1163102538:85 , srv1232971641:85 , srv1273947309:85 , srv1298948417:85 , srv1305608766:85 , srv1312103399:85 , srv1324456388:85 , srv1376585465:85 , srv1394611371:85 , srv1443868449:85 , srv1496383828:85 , srv1512025138:85 , srv1556578656:85 , srv1725240398:85 , srv1743417113:85 , srv1821937849:85 , srv1824880618:85 , srv1842107215:85 , srv1965777173:85 , srv2068219702:85 , srv206882101:85 , srv290095929:85 , srv291861430:85 , srv306308566:85 , srv363189148:85 , srv371163284:85 , srv465533815:85 , srv486095141:85 , srv497395116:85 , srv501240169:85 , srv546734369:85 , srv549552763:85 , srv642438488:85 , srv665994819:85 , srv683661863:85 , srv795017197:85 , srv804764090:85 , srv825034684:85 , srv834376225:85 , srv838839328:85 , srv935609702:85 , srv96453047:85 , srv977661992:85 , srv1090894841:86 , srv1525739570:86 , srv2115619160:86 , srv334930092:86 , srv390728352:86 , srv523402292:86 , srv755877894:86 , srv865285176:86 , srv922330163:86 , srv729823153:626 }
2023-08-07 03:53:16,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:16,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:16,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:16,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:16,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:16,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:16,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:16,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:16,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:16,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:16,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:16,352 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:16,352 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-07 03:53:16,353 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5915927445784734E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-07 03:53:16,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 389 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 2.5915927445784734E-5 to a new imbalance of 6.6220544613879576E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:16,637 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1090894841:83 , srv1394611371:83 , srv1525739570:83 , srv291861430:83 , srv683661863:83 , srv922330163:83 , srv1030773978:84 , srv1049009230:84 , srv1068094227:84 , srv1073963817:84 , srv1099128920:84 , srv1114434742:84 , srv1116870192:84 , srv113851763:84 , srv1150185377:84 , srv1163102538:84 , srv1232971641:84 , srv1273947309:84 , srv1298948417:84 , srv1305608766:84 , srv1312103399:84 , srv1324456388:84 , srv1376585465:84 , srv138420464:84 , srv1411236149:84 , srv1421798579:84 , srv1443868449:84 , srv149520820:84 , srv1496383828:84 , srv1512025138:84 , srv152857161:84 , srv1531640473:84 , srv1556578656:84 , srv1573694475:84 , srv158551307:84 , srv1702195058:84 , srv1725240398:84 , srv1743417113:84 , srv1821937849:84 , srv1824880618:84 , srv1842107215:84 , srv1897613322:84 , srv1941100259:84 , srv1965777173:84 , srv1981800885:84 , srv2044274688:84 , srv2068219702:84 , srv206882101:84 , srv2105883463:84 , srv2115619160:84 , srv22917501:84 , srv264369213:84 , srv290095929:84 , srv306308566:84 , srv334930092:84 , srv338769486:84 , srv354967403:84 , srv363189148:84 , srv371163284:84 , srv390728352:84 , srv418003209:84 , srv451930697:84 , srv465533815:84 , srv475779873:84 , srv482944707:84 , srv486095141:84 , srv497395116:84 , srv501240169:84 , srv523402292:84 , srv546734369:84 , srv549552763:84 , srv577149074:84 , srv601617637:84 , srv608930534:84 , srv631526773:84 , srv642438488:84 , srv665994819:84 , srv701268085:84 , srv755877894:84 , srv758223848:84 , srv795017197:84 , srv804764090:84 , srv825034684:84 , srv834376225:84 , srv838839328:84 , srv85312602:84 , srv865285176:84 , srv935609702:84 , srv958073492:84 , srv96248258:84 , srv96453047:84 , srv969976647:84 , srv977661992:84 , srv1250502060:85 , srv1703710801:85 , srv266151439:85 , srv539864457:85 , srv585479012:85 , srv917341370:85 , srv729823153:684 }
2023-08-07 03:53:16,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:16,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv390728352=60, srv1394611371=20, srv1411236149=21, srv1324456388=17, srv838839328=89, srv1725240398=35, srv264369213=50, srv363189148=58, srv334930092=55, srv1376585465=18, srv834376225=88, srv501240169=68, srv1068094227=2, srv482944707=65, srv1897613322=40, srv1965777173=42, srv290095929=52, srv1525739570=27, srv2115619160=48, srv418003209=61, srv1824880618=38, srv338769486=56, srv601617637=75, srv1099128920=5, srv1941100259=41, srv758223848=84, srv1496383828=25, srv1821937849=37, srv2044274688=44, srv206882101=46, srv865285176=91, srv291861430=53, srv1842107215=39, srv266151439=51, srv729823153=82, srv804764090=86, srv1150185377=9, srv451930697=62, srv825034684=87, srv152857161=28, srv96248258=96, srv539864457=70, srv22917501=49, srv642438488=78, srv631526773=77, srv1743417113=36, srv306308566=54, srv549552763=72, srv486095141=66, srv85312602=90, srv354967403=57, srv917341370=92, srv465533815=63, srv1114434742=6, srv1531640473=29, srv701268085=81, srv935609702=94, srv1298948417=14, srv795017197=85, srv1250502060=12, srv1443868449=23, srv1305608766=15, srv523402292=69, srv1163102538=10, srv138420464=19, srv96453047=97, srv2068219702=45, srv497395116=67, srv1421798579=22, srv1556578656=30, srv149520820=24, srv1312103399=16, srv585479012=74, srv1702195058=33, srv1049009230=1, srv113851763=8, srv158551307=32, srv1073963817=3, srv577149074=73, srv546734369=71, srv608930534=76, srv977661992=99, srv755877894=83, srv1512025138=26, srv922330163=93, srv1030773978=0, srv1703710801=34, srv1981800885=43, srv1573694475=31, srv969976647=98, srv2105883463=47, srv1090894841=4, srv665994819=79, srv1232971641=11, srv1273947309=13, srv1116870192=7, srv371163284=59, srv958073492=95, srv475779873=64, srv683661863=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:16,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:16,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-07 03:53:16,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-07 03:53:16,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-07 03:53:16,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-07 03:53:16,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-07 03:53:16,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-07 03:53:16,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-07 03:53:16,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-07 03:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-07 03:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-07 03:53:16,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-07 03:53:16,812 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:16,812 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1090894841:83 , srv1394611371:83 , srv1525739570:83 , srv291861430:83 , srv683661863:83 , srv922330163:83 , srv1030773978:84 , srv1049009230:84 , srv1068094227:84 , srv1073963817:84 , srv1099128920:84 , srv1114434742:84 , srv1116870192:84 , srv113851763:84 , srv1150185377:84 , srv1163102538:84 , srv1232971641:84 , srv1273947309:84 , srv1298948417:84 , srv1305608766:84 , srv1312103399:84 , srv1324456388:84 , srv1376585465:84 , srv138420464:84 , srv1411236149:84 , srv1421798579:84 , srv1443868449:84 , srv149520820:84 , srv1496383828:84 , srv1512025138:84 , srv152857161:84 , srv1531640473:84 , srv1556578656:84 , srv1573694475:84 , srv158551307:84 , srv1702195058:84 , srv1725240398:84 , srv1743417113:84 , srv1821937849:84 , srv1824880618:84 , srv1842107215:84 , srv1897613322:84 , srv1941100259:84 , srv1965777173:84 , srv1981800885:84 , srv2044274688:84 , srv2068219702:84 , srv206882101:84 , srv2105883463:84 , srv2115619160:84 , srv22917501:84 , srv264369213:84 , srv290095929:84 , srv306308566:84 , srv334930092:84 , srv338769486:84 , srv354967403:84 , srv363189148:84 , srv371163284:84 , srv390728352:84 , srv418003209:84 , srv451930697:84 , srv465533815:84 , srv475779873:84 , srv482944707:84 , srv486095141:84 , srv497395116:84 , srv501240169:84 , srv523402292:84 , srv546734369:84 , srv549552763:84 , srv577149074:84 , srv601617637:84 , srv608930534:84 , srv631526773:84 , srv642438488:84 , srv665994819:84 , srv701268085:84 , srv755877894:84 , srv758223848:84 , srv795017197:84 , srv804764090:84 , srv825034684:84 , srv834376225:84 , srv838839328:84 , srv85312602:84 , srv865285176:84 , srv935609702:84 , srv958073492:84 , srv96248258:84 , srv96453047:84 , srv969976647:84 , srv977661992:84 , srv1250502060:85 , srv1703710801:85 , srv266151439:85 , srv539864457:85 , srv585479012:85 , srv917341370:85 , srv729823153:684 }
2023-08-07 03:53:16,850 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=320 (was 287) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=2866 (was 3729)
2023-08-07 03:53:16,862 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=320, ProcessCount=173, AvailableMemoryMB=2864
2023-08-07 03:53:16,863 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-07 03:53:16,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-07 03:53:16,878 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1142177518:84 , srv1265052337:84 , srv1276909011:84 , srv1280097110:84 , srv132918654:84 , srv1542584093:84 , srv1544097250:84 , srv162019844:84 , srv1672334607:84 , srv1704666333:84 , srv1806167525:84 , srv183302991:84 , srv1834642062:84 , srv2006491802:84 , srv2135555343:84 , srv2144870149:84 , srv287172053:84 , srv349772415:84 , srv389384930:84 , srv436649664:84 , srv4860372:84 , srv545334674:84 , srv546546846:84 , srv649681444:84 , srv65581673:84 , srv698168408:84 , srv708815840:84 , srv725705317:84 , srv788165782:84 , srv808843445:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-07 03:53:16,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:53:16,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1672334607=8, srv1276909011=2, srv1806167525=10, srv649681444=23, srv287172053=16, srv132918654=4, srv1834642062=12, srv808843445=29, srv1544097250=6, srv65581673=24, srv2135555343=14, srv4860372=20, srv546546846=22, srv788165782=28, srv545334674=21, srv1265052337=1, srv708815840=26, srv1704666333=9, srv2006491802=13, srv183302991=11, srv725705317=27, srv1280097110=3, srv162019844=7, srv436649664=19, srv698168408=25, srv2144870149=15, srv1142177518=0, srv1542584093=5, srv349772415=17, srv389384930=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:53:16,894 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:53:16,895 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:53:16,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 03:53:16,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1315648044361728, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:53:16,923 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912607599667072, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1315648044361728, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-07 03:55:16,901 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5489234 different iterations.  Found a solution that moves 1876 regions; Going from a computed imbalance of 0.9912607599667072 to a new imbalance of 4.37867758735265E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6948148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:55:16,909 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1142177518:90 , srv1265052337:90 , srv1276909011:90 , srv1280097110:90 , srv132918654:90 , srv1542584093:90 , srv1544097250:90 , srv162019844:90 , srv1672334607:90 , srv1704666333:90 , srv1806167525:90 , srv183302991:90 , srv1834642062:90 , srv2006491802:90 , srv2135555343:90 , srv2144870149:90 , srv287172053:90 , srv349772415:90 , srv389384930:90 , srv436649664:90 , srv4860372:90 , srv545334674:90 , srv546546846:90 , srv649681444:90 , srv65581673:90 , srv698168408:90 , srv708815840:90 , srv725705317:90 , srv788165782:90 , srv808843445:90 }
2023-08-07 03:55:16,911 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-07 03:55:16,912 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1672334607=8, srv1276909011=2, srv1806167525=10, srv649681444=23, srv287172053=16, srv132918654=4, srv1834642062=12, srv808843445=29, srv1544097250=6, srv65581673=24, srv2135555343=14, srv4860372=20, srv546546846=22, srv788165782=28, srv545334674=21, srv1265052337=1, srv708815840=26, srv1704666333=9, srv2006491802=13, srv183302991=11, srv725705317=27, srv1280097110=3, srv162019844=7, srv436649664=19, srv698168408=25, srv2144870149=15, srv1142177518=0, srv1542584093=5, srv349772415=17, srv389384930=18} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-07 03:55:16,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-07 03:55:16,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-07 03:55:16,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-07 03:55:16,933 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-07 03:55:16,933 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1142177518:90 , srv1265052337:90 , srv1276909011:90 , srv1280097110:90 , srv132918654:90 , srv1542584093:90 , srv1544097250:90 , srv162019844:90 , srv1672334607:90 , srv1704666333:90 , srv1806167525:90 , srv183302991:90 , srv1834642062:90 , srv2006491802:90 , srv2135555343:90 , srv2144870149:90 , srv287172053:90 , srv349772415:90 , srv389384930:90 , srv436649664:90 , srv4860372:90 , srv545334674:90 , srv546546846:90 , srv649681444:90 , srv65581673:90 , srv698168408:90 , srv708815840:90 , srv725705317:90 , srv788165782:90 , srv808843445:90 }
2023-08-07 03:55:16,950 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 320), ProcessCount=173 (was 173), AvailableMemoryMB=2858 (was 2864)