2023-12-26 21:53:18,620 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-12-26 21:53:18,957 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-12-26 21:53:19,096 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-12-26 21:53:19,191 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 21:53:19,202 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-26 21:53:19,218 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=177, AvailableMemoryMB=11647
2023-12-26 21:53:19,221 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 21:53:19,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-12-26 21:53:19,354 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002815158:84 , srv1030314776:84 , srv1042912614:84 , srv1062242050:84 , srv1073355690:84 , srv1116708436:84 , srv1122813001:84 , srv1142827215:84 , srv1154341171:84 , srv1161018697:84 , srv1201937488:84 , srv1230587674:84 , srv1237720651:84 , srv1241153150:84 , srv1241188833:84 , srv1246112842:84 , srv1257716998:84 , srv1295309547:84 , srv1300354772:84 , srv1316811655:84 , srv1320698992:84 , srv1356736592:84 , srv1357170080:84 , srv1388729132:84 , srv1389623173:84 , srv1486433074:84 , srv1493054180:84 , srv1548207839:84 , srv1551297862:84 , srv1553581780:84 , srv1562697336:84 , srv1590774685:84 , srv1642904508:84 , srv1655850905:84 , srv1670270322:84 , srv1723781829:84 , srv1724248648:84 , srv1728542420:84 , srv177983426:84 , srv1785489873:84 , srv180005235:84 , srv18096969:84 , srv1878477923:84 , srv1885692461:84 , srv1889940132:84 , srv1907171586:84 , srv1924497059:84 , srv1952963366:84 , srv1970984562:84 , srv1999727310:84 , srv2011031321:84 , srv2039388603:84 , srv2045095708:84 , srv2045944640:84 , srv2067113520:84 , srv2094222746:84 , srv212484271:84 , srv2147024420:84 , srv229957866:84 , srv264044573:84 , srv285413115:84 , srv287697028:84 , srv325470916:84 , srv337564160:84 , srv34740641:84 , srv40100653:84 , srv409276720:84 , srv419029349:84 , srv459274850:84 , srv461373981:84 , srv46874616:84 , srv490398827:84 , srv491820244:84 , srv514514233:84 , srv527717164:84 , srv541847174:84 , srv560491275:84 , srv597889191:84 , srv606490846:84 , srv617217027:84 , srv645542736:84 , srv645578626:84 , srv647863862:84 , srv651914545:84 , srv686125228:84 , srv697104744:84 , srv756544261:84 , srv76645116:84 , srv771681151:84 , srv805965226:84 , srv820406399:84 , srv821610650:84 , srv899280159:84 , srv903485736:84 , srv91741636:84 , srv926007066:84 , srv966108249:84 , srv986510389:84 , srv994880125:84 , srv1556815782:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-12-26 21:53:19,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:19,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:19,471 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:19,472 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:19,473 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:19,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:19,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:19,476 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:19,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:19,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:19,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:19,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:19,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:19,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:19,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:19,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:19,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:19,706 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:19,707 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 21:53:19,707 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 21:53:20,171 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 660 ms to try 5000 different iterations.  Found a solution that moves 4680 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18038674806509664. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04454394025894255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05702894690974154, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.52, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04454394025894255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24141666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:20,192 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1878477923:81 , srv91741636:81 , srv1230587674:82 , srv1241153150:82 , srv1241188833:82 , srv1320698992:82 , srv2094222746:82 , srv229957866:82 , srv1062242050:83 , srv1356736592:83 , srv1670270322:83 , srv1970984562:83 , srv2067113520:83 , srv459274850:83 , srv647863862:83 , srv686125228:83 , srv756544261:83 , srv994880125:83 , srv1030314776:84 , srv1142827215:84 , srv1246112842:84 , srv1486433074:84 , srv1885692461:84 , srv285413115:84 , srv337564160:84 , srv491820244:84 , srv76645116:84 , srv966108249:84 , srv1548207839:85 , srv1642904508:85 , srv1723781829:85 , srv1728542420:85 , srv1785489873:85 , srv212484271:85 , srv2147024420:85 , srv264044573:85 , srv46874616:85 , srv560491275:85 , srv606490846:85 , srv617217027:85 , srv645542736:85 , srv697104744:85 , srv899280159:85 , srv903485736:85 , srv1116708436:86 , srv1161018697:86 , srv1237720651:86 , srv1257716998:86 , srv1316811655:86 , srv1357170080:86 , srv1389623173:86 , srv1724248648:86 , srv177983426:86 , srv180005235:86 , srv2039388603:86 , srv2045095708:86 , srv651914545:86 , srv820406399:86 , srv1002815158:87 , srv1073355690:87 , srv1295309547:87 , srv1562697336:87 , srv1590774685:87 , srv2011031321:87 , srv2045944640:87 , srv325470916:87 , srv409276720:87 , srv461373981:87 , srv527717164:87 , srv541847174:87 , srv597889191:87 , srv645578626:87 , srv926007066:87 , srv986510389:87 , srv1154341171:88 , srv1493054180:88 , srv1553581780:88 , srv1655850905:88 , srv18096969:88 , srv1889940132:88 , srv1907171586:88 , srv1999727310:88 , srv514514233:88 , srv821610650:88 , srv1042912614:89 , srv1122813001:89 , srv1201937488:89 , srv1388729132:89 , srv1551297862:89 , srv1924497059:89 , srv1952963366:89 , srv34740641:89 , srv40100653:89 , srv287697028:90 , srv419029349:90 , srv805965226:90 , srv1300354772:91 , srv490398827:94 , srv771681151:98 , srv1556815782:486 }
2023-12-26 21:53:20,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:20,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:20,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:20,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:20,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:20,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:20,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:20,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:20,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:20,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:20,234 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:20,235 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:20,236 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:20,237 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:20,238 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:20,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:20,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:20,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04454394025894255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05702894690974154, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04454394025894255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24141666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:20,388 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 21:53:20,388 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1803539780046881, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04454394025894255, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05702894690974154, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04454394025894255, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17566666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24141666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 21:53:20,696 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 424 ms to try 5000 different iterations.  Found a solution that moves 2659 regions; Going from a computed imbalance of 0.1803539780046881 to a new imbalance of 0.015514436563455218. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023394447249614102); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030759192871854524, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29544444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023394447249614102); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:20,706 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv771681151:74 , srv490398827:77 , srv419029349:81 , srv1042912614:82 , srv1300354772:82 , srv1388729132:82 , srv1551297862:82 , srv287697028:82 , srv514514233:82 , srv805965226:82 , srv1201937488:83 , srv1493054180:83 , srv1889940132:83 , srv1924497059:83 , srv337564160:83 , srv40100653:83 , srv461373981:83 , srv541847174:83 , srv597889191:83 , srv820406399:83 , srv821610650:83 , srv1073355690:84 , srv1295309547:84 , srv1553581780:84 , srv1562697336:84 , srv1590774685:84 , srv1999727310:84 , srv2011031321:84 , srv2039388603:84 , srv2045944640:84 , srv325470916:84 , srv34740641:84 , srv527717164:84 , srv645578626:84 , srv1154341171:85 , srv1257716998:85 , srv1357170080:85 , srv1655850905:85 , srv1952963366:85 , srv409276720:85 , srv966108249:85 , srv1002815158:86 , srv1116708436:86 , srv1316811655:86 , srv1548207839:86 , srv1723781829:86 , srv18096969:86 , srv2147024420:86 , srv697104744:86 , srv926007066:86 , srv1122813001:87 , srv1142827215:87 , srv1161018697:87 , srv1246112842:87 , srv1389623173:87 , srv1642904508:87 , srv1724248648:87 , srv177983426:87 , srv180005235:87 , srv1907171586:87 , srv1970984562:87 , srv2045095708:87 , srv212484271:87 , srv560491275:87 , srv617217027:87 , srv651914545:87 , srv76645116:87 , srv899280159:87 , srv986510389:87 , srv1230587674:88 , srv1237720651:88 , srv1241153150:88 , srv1356736592:88 , srv1486433074:88 , srv1728542420:88 , srv1785489873:88 , srv2067113520:88 , srv229957866:88 , srv264044573:88 , srv46874616:88 , srv491820244:88 , srv606490846:88 , srv645542736:88 , srv756544261:88 , srv903485736:88 , srv1030314776:89 , srv1062242050:89 , srv1885692461:89 , srv459274850:89 , srv1241188833:90 , srv1670270322:90 , srv285413115:90 , srv686125228:90 , srv994880125:90 , srv1320698992:91 , srv1878477923:91 , srv2094222746:91 , srv647863862:91 , srv91741636:93 , srv1556815782:496 }
2023-12-26 21:53:20,710 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:20,711 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:20,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:20,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:20,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:20,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:20,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:20,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:20,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:20,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:20,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:20,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:20,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:20,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:20,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023394447249614102); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030759192871854524, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023394447249614102); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:20,916 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 21:53:20,916 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01549581784750942, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023394447249614102); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.030759192871854524, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023394447249614102); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0125); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.044333333333333336, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 21:53:21,280 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 499 ms to try 5000 different iterations.  Found a solution that moves 1022 regions; Going from a computed imbalance of 0.01549581784750942 to a new imbalance of 9.230395214735367E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005870957176801911); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.11355555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005870957176801911); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:21,282 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1122813001:81 , srv18096969:83 , srv1907171586:83 , srv647863862:83 , srv1161018697:84 , srv1300354772:84 , srv1389623173:84 , srv177983426:84 , srv1785489873:84 , srv180005235:84 , srv1952963366:84 , srv2045095708:84 , srv285413115:84 , srv34740641:84 , srv686125228:84 , srv903485736:84 , srv91741636:84 , srv986510389:84 , srv1002815158:85 , srv1030314776:85 , srv1062242050:85 , srv1154341171:85 , srv1201937488:85 , srv1237720651:85 , srv1320698992:85 , srv1486433074:85 , srv1553581780:85 , srv1642904508:85 , srv1655850905:85 , srv1670270322:85 , srv1724248648:85 , srv1878477923:85 , srv1885692461:85 , srv2094222746:85 , srv212484271:85 , srv264044573:85 , srv40100653:85 , srv409276720:85 , srv459274850:85 , srv46874616:85 , srv491820244:85 , srv606490846:85 , srv617217027:85 , srv645542736:85 , srv926007066:85 , srv994880125:85 , srv1042912614:86 , srv1116708436:86 , srv1241188833:86 , srv1246112842:86 , srv1257716998:86 , srv1295309547:86 , srv1316811655:86 , srv1356736592:86 , srv1357170080:86 , srv1388729132:86 , srv1493054180:86 , srv1548207839:86 , srv1551297862:86 , srv1562697336:86 , srv1723781829:86 , srv1728542420:86 , srv1924497059:86 , srv1999727310:86 , srv2011031321:86 , srv2045944640:86 , srv2067113520:86 , srv2147024420:86 , srv287697028:86 , srv490398827:86 , srv527717164:86 , srv560491275:86 , srv645578626:86 , srv651914545:86 , srv697104744:86 , srv756544261:86 , srv771681151:86 , srv805965226:86 , srv899280159:86 , srv1073355690:87 , srv1142827215:87 , srv1230587674:87 , srv1241153150:87 , srv1590774685:87 , srv1889940132:87 , srv1970984562:87 , srv2039388603:87 , srv229957866:87 , srv325470916:87 , srv419029349:87 , srv461373981:87 , srv514514233:87 , srv597889191:87 , srv76645116:87 , srv541847174:88 , srv820406399:88 , srv821610650:88 , srv966108249:89 , srv337564160:90 , srv1556815782:528 }
2023-12-26 21:53:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:21,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:21,300 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:21,301 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:21,302 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:21,303 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:21,304 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:21,305 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:21,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:21,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005870957176801911); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005870957176801911); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:21,438 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 21:53:21,439 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=9.158833245210723E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005870957176801911); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0071852198964762574); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005870957176801911); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 21:53:21,834 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 514 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 9.158833245210723E-4 to a new imbalance of 5.922291181923134E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:21,835 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1237720651:83 , srv1655850905:83 , srv1728542420:83 , srv1999727310:83 , srv1002815158:84 , srv1030314776:84 , srv1073355690:84 , srv1116708436:84 , srv1142827215:84 , srv1154341171:84 , srv1201937488:84 , srv1241188833:84 , srv1295309547:84 , srv1316811655:84 , srv1320698992:84 , srv1590774685:84 , srv1724248648:84 , srv18096969:84 , srv1885692461:84 , srv1889940132:84 , srv1907171586:84 , srv1924497059:84 , srv1952963366:84 , srv2045944640:84 , srv2067113520:84 , srv2147024420:84 , srv264044573:84 , srv285413115:84 , srv287697028:84 , srv325470916:84 , srv541847174:84 , srv597889191:84 , srv606490846:84 , srv617217027:84 , srv645542736:84 , srv651914545:84 , srv76645116:84 , srv771681151:84 , srv805965226:84 , srv821610650:84 , srv899280159:84 , srv91741636:84 , srv926007066:84 , srv966108249:84 , srv986510389:84 , srv994880125:84 , srv1042912614:85 , srv1062242050:85 , srv1122813001:85 , srv1161018697:85 , srv1230587674:85 , srv1241153150:85 , srv1246112842:85 , srv1257716998:85 , srv1300354772:85 , srv1356736592:85 , srv1357170080:85 , srv1388729132:85 , srv1389623173:85 , srv1486433074:85 , srv1493054180:85 , srv1548207839:85 , srv1553581780:85 , srv1562697336:85 , srv1642904508:85 , srv1670270322:85 , srv1723781829:85 , srv177983426:85 , srv1785489873:85 , srv180005235:85 , srv1878477923:85 , srv1970984562:85 , srv2011031321:85 , srv2039388603:85 , srv2045095708:85 , srv2094222746:85 , srv212484271:85 , srv229957866:85 , srv337564160:85 , srv40100653:85 , srv419029349:85 , srv459274850:85 , srv461373981:85 , srv46874616:85 , srv490398827:85 , srv491820244:85 , srv514514233:85 , srv527717164:85 , srv560491275:85 , srv645578626:85 , srv647863862:85 , srv686125228:85 , srv697104744:85 , srv756544261:85 , srv820406399:85 , srv903485736:85 , srv1551297862:86 , srv34740641:86 , srv409276720:86 , srv1556815782:632 }
2023-12-26 21:53:21,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:21,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:21,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:21,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:21,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:21,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:21,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:21,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:21,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:21,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:21,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:21,963 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:21,964 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-12-26 21:53:21,964 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.719228841784712E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-12-26 21:53:22,223 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 357 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 5.719228841784712E-5 to a new imbalance of 8.518843523409391E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:22,224 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1551297862:83 , srv1670270322:83 , srv2094222746:83 , srv34740641:83 , srv409276720:83 , srv419029349:83 , srv46874616:83 , srv560491275:83 , srv651914545:83 , srv821610650:83 , srv1002815158:84 , srv1030314776:84 , srv1042912614:84 , srv1062242050:84 , srv1073355690:84 , srv1116708436:84 , srv1122813001:84 , srv1142827215:84 , srv1154341171:84 , srv1161018697:84 , srv1230587674:84 , srv1237720651:84 , srv1241153150:84 , srv1241188833:84 , srv1246112842:84 , srv1257716998:84 , srv1300354772:84 , srv1316811655:84 , srv1320698992:84 , srv1356736592:84 , srv1357170080:84 , srv1388729132:84 , srv1389623173:84 , srv1486433074:84 , srv1493054180:84 , srv1548207839:84 , srv1553581780:84 , srv1562697336:84 , srv1590774685:84 , srv1642904508:84 , srv1723781829:84 , srv1724248648:84 , srv1728542420:84 , srv177983426:84 , srv1785489873:84 , srv180005235:84 , srv1878477923:84 , srv1885692461:84 , srv1889940132:84 , srv1907171586:84 , srv1924497059:84 , srv1952963366:84 , srv1970984562:84 , srv2011031321:84 , srv2039388603:84 , srv2045095708:84 , srv212484271:84 , srv229957866:84 , srv264044573:84 , srv285413115:84 , srv287697028:84 , srv325470916:84 , srv337564160:84 , srv40100653:84 , srv459274850:84 , srv461373981:84 , srv490398827:84 , srv491820244:84 , srv514514233:84 , srv527717164:84 , srv541847174:84 , srv606490846:84 , srv645542736:84 , srv645578626:84 , srv647863862:84 , srv686125228:84 , srv697104744:84 , srv756544261:84 , srv76645116:84 , srv771681151:84 , srv805965226:84 , srv820406399:84 , srv899280159:84 , srv903485736:84 , srv91741636:84 , srv926007066:84 , srv966108249:84 , srv986510389:84 , srv994880125:84 , srv1201937488:85 , srv1295309547:85 , srv1655850905:85 , srv18096969:85 , srv1999727310:85 , srv2045944640:85 , srv2067113520:85 , srv2147024420:85 , srv597889191:85 , srv617217027:85 , srv1556815782:684 }
2023-12-26 21:53:22,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:22,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1924497059=47, srv40100653=66, srv287697028=62, srv771681151=89, srv821610650=92, srv212484271=57, srv1201937488=10, srv805965226=90, srv285413115=61, srv1486433074=25, srv1999727310=50, srv459274850=69, srv76645116=88, srv177983426=39, srv756544261=87, srv2039388603=52, srv1142827215=7, srv1878477923=43, srv1356736592=21, srv491820244=73, srv514514233=74, srv651914545=84, srv1246112842=15, srv1161018697=9, srv1002815158=0, srv986510389=98, srv91741636=95, srv1388729132=23, srv1724248648=37, srv903485736=94, srv926007066=96, srv560491275=77, srv527717164=75, srv2067113520=55, srv994880125=99, srv2045944640=54, srv1230587674=11, srv1952963366=48, srv1670270322=35, srv46874616=71, srv490398827=72, srv337564160=64, srv2011031321=51, srv1241188833=14, srv1154341171=8, srv1907171586=46, srv180005235=41, srv1357170080=22, srv697104744=86, srv1889940132=45, srv1073355690=4, srv647863862=83, srv264044573=60, srv1389623173=24, srv1553581780=29, srv1241153150=13, srv325470916=63, srv1295309547=17, srv34740641=65, srv606490846=79, srv1728542420=38, srv645578626=82, srv1785489873=40, srv966108249=97, srv1316811655=19, srv1062242050=3, srv1320698992=20, srv1642904508=33, srv2147024420=58, srv2094222746=56, srv899280159=93, srv1116708436=5, srv409276720=67, srv18096969=42, srv1970984562=49, srv1551297862=28, srv461373981=70, srv686125228=85, srv1300354772=18, srv1042912614=2, srv645542736=81, srv419029349=68, srv1548207839=27, srv1237720651=12, srv1562697336=31, srv1030314776=1, srv1493054180=26, srv1723781829=36, srv1885692461=44, srv597889191=78, srv820406399=91, srv541847174=76, srv1590774685=32, srv2045095708=53, srv1556815782=30, srv1122813001=6, srv229957866=59, srv1655850905=34, srv1257716998=16, srv617217027=80} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:22,239 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-12-26 21:53:22,240 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-12-26 21:53:22,241 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-12-26 21:53:22,242 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-12-26 21:53:22,243 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-12-26 21:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-12-26 21:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-12-26 21:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-12-26 21:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-12-26 21:53:22,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-12-26 21:53:22,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.259763985991403E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:22,349 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1551297862:83 , srv1670270322:83 , srv2094222746:83 , srv34740641:83 , srv409276720:83 , srv419029349:83 , srv46874616:83 , srv560491275:83 , srv651914545:83 , srv821610650:83 , srv1002815158:84 , srv1030314776:84 , srv1042912614:84 , srv1062242050:84 , srv1073355690:84 , srv1116708436:84 , srv1122813001:84 , srv1142827215:84 , srv1154341171:84 , srv1161018697:84 , srv1230587674:84 , srv1237720651:84 , srv1241153150:84 , srv1241188833:84 , srv1246112842:84 , srv1257716998:84 , srv1300354772:84 , srv1316811655:84 , srv1320698992:84 , srv1356736592:84 , srv1357170080:84 , srv1388729132:84 , srv1389623173:84 , srv1486433074:84 , srv1493054180:84 , srv1548207839:84 , srv1553581780:84 , srv1562697336:84 , srv1590774685:84 , srv1642904508:84 , srv1723781829:84 , srv1724248648:84 , srv1728542420:84 , srv177983426:84 , srv1785489873:84 , srv180005235:84 , srv1878477923:84 , srv1885692461:84 , srv1889940132:84 , srv1907171586:84 , srv1924497059:84 , srv1952963366:84 , srv1970984562:84 , srv2011031321:84 , srv2039388603:84 , srv2045095708:84 , srv212484271:84 , srv229957866:84 , srv264044573:84 , srv285413115:84 , srv287697028:84 , srv325470916:84 , srv337564160:84 , srv40100653:84 , srv459274850:84 , srv461373981:84 , srv490398827:84 , srv491820244:84 , srv514514233:84 , srv527717164:84 , srv541847174:84 , srv606490846:84 , srv645542736:84 , srv645578626:84 , srv647863862:84 , srv686125228:84 , srv697104744:84 , srv756544261:84 , srv76645116:84 , srv771681151:84 , srv805965226:84 , srv820406399:84 , srv899280159:84 , srv903485736:84 , srv91741636:84 , srv926007066:84 , srv966108249:84 , srv986510389:84 , srv994880125:84 , srv1201937488:85 , srv1295309547:85 , srv1655850905:85 , srv18096969:85 , srv1999727310:85 , srv2045944640:85 , srv2067113520:85 , srv2147024420:85 , srv597889191:85 , srv617217027:85 , srv1556815782:684 }
2023-12-26 21:53:22,379 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=321 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 177), AvailableMemoryMB=11049 (was 11647)
2023-12-26 21:53:22,388 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=177, AvailableMemoryMB=11048
2023-12-26 21:53:22,389 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-12-26 21:53:22,389 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-12-26 21:53:22,401 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1072538653:84 , srv1173847098:84 , srv1219046956:84 , srv1225008952:84 , srv1651525795:84 , srv1699853433:84 , srv1832737109:84 , srv1842560686:84 , srv1887911296:84 , srv1923686663:84 , srv1930759799:84 , srv1979738584:84 , srv233047329:84 , srv284180660:84 , srv340225009:84 , srv37264128:84 , srv465130978:84 , srv540236333:84 , srv54229390:84 , srv558916836:84 , srv566681277:84 , srv581417506:84 , srv665769647:84 , srv743378407:84 , srv8251326:84 , srv842898193:84 , srv888341660:84 , srv908158337:84 , srv949775035:84 , srv640334164:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-12-26 21:53:22,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:53:22,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1979738584=11, srv1832737109=6, srv1923686663=9, srv1651525795=4, srv340225009=14, srv558916836=19, srv842898193=26, srv1930759799=10, srv54229390=18, srv37264128=15, srv284180660=13, srv233047329=12, srv665769647=23, srv1072538653=0, srv1887911296=8, srv908158337=28, srv1842560686=7, srv1219046956=2, srv1699853433=5, srv1225008952=3, srv1173847098=1, srv566681277=20, srv743378407=24, srv888341660=27, srv640334164=22, srv949775035=29, srv540236333=17, srv8251326=25, srv465130978=16, srv581417506=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:53:22,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:53:22,416 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:53:22,417 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:53:22,418 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-26 21:53:22,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.163383708324582, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:53:22,444 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912707859994241, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.163383708324582, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-12-26 21:55:22,423 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5486434 different iterations.  Found a solution that moves 1862 regions; Going from a computed imbalance of 0.9912707859994241 to a new imbalance of 4.346000888939571E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6896296296296296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:55:22,430 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1072538653:90 , srv1173847098:90 , srv1219046956:90 , srv1225008952:90 , srv1651525795:90 , srv1699853433:90 , srv1832737109:90 , srv1842560686:90 , srv1887911296:90 , srv1923686663:90 , srv1930759799:90 , srv1979738584:90 , srv233047329:90 , srv284180660:90 , srv340225009:90 , srv37264128:90 , srv465130978:90 , srv540236333:90 , srv54229390:90 , srv558916836:90 , srv566681277:90 , srv581417506:90 , srv640334164:90 , srv665769647:90 , srv743378407:90 , srv8251326:90 , srv842898193:90 , srv888341660:90 , srv908158337:90 , srv949775035:90 }
2023-12-26 21:55:22,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-12-26 21:55:22,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1979738584=11, srv1832737109=6, srv1923686663=9, srv1651525795=4, srv340225009=14, srv558916836=19, srv842898193=26, srv1930759799=10, srv54229390=18, srv37264128=15, srv284180660=13, srv233047329=12, srv665769647=23, srv1072538653=0, srv1887911296=8, srv908158337=28, srv1842560686=7, srv1219046956=2, srv1699853433=5, srv1225008952=3, srv1173847098=1, srv566681277=20, srv743378407=24, srv888341660=27, srv640334164=22, srv949775035=29, srv540236333=17, srv8251326=25, srv465130978=16, srv581417506=21} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-12-26 21:55:22,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-12-26 21:55:22,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-12-26 21:55:22,450 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-12-26 21:55:22,450 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1072538653:90 , srv1173847098:90 , srv1219046956:90 , srv1225008952:90 , srv1651525795:90 , srv1699853433:90 , srv1832737109:90 , srv1842560686:90 , srv1887911296:90 , srv1923686663:90 , srv1930759799:90 , srv1979738584:90 , srv233047329:90 , srv284180660:90 , srv340225009:90 , srv37264128:90 , srv465130978:90 , srv540236333:90 , srv54229390:90 , srv558916836:90 , srv566681277:90 , srv581417506:90 , srv640334164:90 , srv665769647:90 , srv743378407:90 , srv8251326:90 , srv842898193:90 , srv888341660:90 , srv908158337:90 , srv949775035:90 }
2023-12-26 21:55:22,462 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 321), ProcessCount=170 (was 177), AvailableMemoryMB=9961 (was 11048)