2023-07-14 19:08:32,467 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-07-14 19:08:32,713 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-07-14 19:08:32,804 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-07-14 19:08:32,860 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-14 19:08:32,866 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-14 19:08:32,877 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=6753
2023-07-14 19:08:32,878 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-14 19:08:32,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-07-14 19:08:32,997 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002046997:84 , srv1011683010:84 , srv1065580368:84 , srv1066964527:84 , srv1105338781:84 , srv1140013645:84 , srv1151002841:84 , srv1156685892:84 , srv1166611808:84 , srv1189059510:84 , srv1253187506:84 , srv125615377:84 , srv1263300830:84 , srv1271774209:84 , srv1279831783:84 , srv1318985730:84 , srv1328789194:84 , srv1356212516:84 , srv138921240:84 , srv139044730:84 , srv1427068543:84 , srv1433687475:84 , srv1471942407:84 , srv1495522827:84 , srv1520237125:84 , srv1552403062:84 , srv1607725606:84 , srv1636668258:84 , srv1644077568:84 , srv1644928615:84 , srv1651225466:84 , srv1666310825:84 , srv1666779023:84 , srv167592952:84 , srv1702907980:84 , srv1721245549:84 , srv1723043554:84 , srv1740307933:84 , srv1765930144:84 , srv1766981544:84 , srv17695690:84 , srv1771217335:84 , srv1779576573:84 , srv1818067205:84 , srv186037912:84 , srv1866691097:84 , srv1872292029:84 , srv1918470730:84 , srv1937123256:84 , srv1949012362:84 , srv2017171654:84 , srv2025380748:84 , srv2043228829:84 , srv2077023316:84 , srv2078265213:84 , srv2085829311:84 , srv2115558498:84 , srv2117796342:84 , srv2143474024:84 , srv2144418277:84 , srv221977410:84 , srv222298808:84 , srv280186183:84 , srv290097825:84 , srv290423734:84 , srv296349689:84 , srv304054152:84 , srv305520918:84 , srv344319430:84 , srv423831441:84 , srv481074760:84 , srv532058886:84 , srv546912380:84 , srv562850614:84 , srv571053507:84 , srv574990756:84 , srv575448552:84 , srv578040091:84 , srv582672194:84 , srv585603096:84 , srv597772557:84 , srv613855629:84 , srv614131662:84 , srv637736099:84 , srv652957747:84 , srv712941009:84 , srv72497894:84 , srv7263454:84 , srv726859075:84 , srv736240400:84 , srv800587198:84 , srv832304271:84 , srv843508119:84 , srv876695807:84 , srv902315425:84 , srv941398666:84 , srv944893791:84 , srv957637200:84 , srv975643562:84 , srv484340950:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-07-14 19:08:33,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:33,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:33,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:33,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:33,080 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:33,081 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:33,082 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:33,083 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:33,084 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:33,085 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:33,086 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:33,087 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:33,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:33,297 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-14 19:08:33,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-14 19:08:33,795 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 686 ms to try 5000 different iterations.  Found a solution that moves 4676 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18434692141730077. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051452346747993, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05778166265105686, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5195555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051452346747993, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:33,814 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1011683010:80 , srv125615377:81 , srv532058886:81 , srv1189059510:82 , srv1644928615:82 , srv1263300830:83 , srv1279831783:83 , srv1427068543:83 , srv1702907980:83 , srv304054152:83 , srv546912380:83 , srv597772557:83 , srv613855629:83 , srv1065580368:84 , srv1471942407:84 , srv1607725606:84 , srv1651225466:84 , srv1872292029:84 , srv1937123256:84 , srv2077023316:84 , srv2117796342:84 , srv637736099:84 , srv652957747:84 , srv843508119:84 , srv957637200:84 , srv1253187506:85 , srv1666779023:85 , srv1779576573:85 , srv186037912:85 , srv2115558498:85 , srv280186183:85 , srv290423734:85 , srv296349689:85 , srv736240400:85 , srv876695807:85 , srv941398666:85 , srv944893791:85 , srv1066964527:86 , srv1105338781:86 , srv1140013645:86 , srv1271774209:86 , srv1328789194:86 , srv138921240:86 , srv1433687475:86 , srv1552403062:86 , srv167592952:86 , srv1723043554:86 , srv1765930144:86 , srv1771217335:86 , srv2143474024:86 , srv344319430:86 , srv481074760:86 , srv7263454:86 , srv1002046997:87 , srv1166611808:87 , srv1318985730:87 , srv1356212516:87 , srv1644077568:87 , srv17695690:87 , srv2017171654:87 , srv2025380748:87 , srv2043228829:87 , srv2078265213:87 , srv2085829311:87 , srv423831441:87 , srv571053507:87 , srv574990756:87 , srv585603096:87 , srv712941009:87 , srv726859075:87 , srv1151002841:88 , srv1636668258:88 , srv1666310825:88 , srv1740307933:88 , srv1918470730:88 , srv222298808:88 , srv290097825:88 , srv562850614:88 , srv578040091:88 , srv582672194:88 , srv72497894:88 , srv902315425:88 , srv139044730:89 , srv1520237125:89 , srv1766981544:89 , srv305520918:89 , srv1495522827:90 , srv1721245549:90 , srv1818067205:90 , srv1866691097:90 , srv1949012362:90 , srv614131662:90 , srv832304271:90 , srv975643562:90 , srv575448552:91 , srv2144418277:93 , srv221977410:93 , srv1156685892:94 , srv800587198:94 , srv484340950:450 }
2023-07-14 19:08:33,817 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:33,818 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:33,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:33,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:33,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:33,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:33,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:33,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:33,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:33,839 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:33,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051452346747993, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05778166265105686, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051452346747993, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:33,962 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-14 19:08:33,962 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18431417936549088, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04051452346747993, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05778166265105686, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04051452346747993, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17975, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24475, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-14 19:08:34,183 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 327 ms to try 5000 different iterations.  Found a solution that moves 2651 regions; Going from a computed imbalance of 0.18431417936549088 to a new imbalance of 0.016472192471391846. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02475216978299489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037088180177334694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29455555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02475216978299489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,191 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1156685892:77 , srv221977410:78 , srv800587198:78 , srv614131662:80 , srv975643562:80 , srv139044730:81 , srv1666310825:81 , srv305520918:81 , srv1495522827:82 , srv1721245549:82 , srv1866691097:82 , srv2144418277:82 , srv222298808:82 , srv832304271:82 , srv1140013645:83 , srv1318985730:83 , srv1644077568:83 , srv1766981544:83 , srv1818067205:83 , srv1918470730:83 , srv2078265213:83 , srv481074760:83 , srv575448552:83 , srv712941009:83 , srv1552403062:84 , srv1740307933:84 , srv1771217335:84 , srv2085829311:84 , srv290097825:84 , srv578040091:84 , srv582672194:84 , srv585603096:84 , srv72497894:84 , srv1002046997:85 , srv1105338781:85 , srv1151002841:85 , srv1166611808:85 , srv1253187506:85 , srv1520237125:85 , srv1723043554:85 , srv2017171654:85 , srv2143474024:85 , srv290423734:85 , srv902315425:85 , srv944893791:85 , srv1065580368:86 , srv1066964527:86 , srv1271774209:86 , srv1356212516:86 , srv1607725606:86 , srv1636668258:86 , srv1765930144:86 , srv17695690:86 , srv1872292029:86 , srv1949012362:86 , srv2025380748:86 , srv2043228829:86 , srv423831441:86 , srv637736099:86 , srv7263454:86 , srv726859075:86 , srv843508119:86 , srv876695807:86 , srv1189059510:87 , srv1328789194:87 , srv1433687475:87 , srv1651225466:87 , srv167592952:87 , srv1779576573:87 , srv2077023316:87 , srv2115558498:87 , srv2117796342:87 , srv280186183:87 , srv562850614:87 , srv571053507:87 , srv574990756:87 , srv597772557:87 , srv941398666:87 , srv138921240:88 , srv1471942407:88 , srv1644928615:88 , srv1666779023:88 , srv186037912:88 , srv1937123256:88 , srv296349689:88 , srv344319430:88 , srv546912380:88 , srv613855629:88 , srv652957747:88 , srv957637200:88 , srv1011683010:89 , srv304054152:89 , srv736240400:89 , srv125615377:90 , srv1427068543:90 , srv1702907980:90 , srv1263300830:92 , srv1279831783:92 , srv532058886:92 , srv484340950:544 }
2023-07-14 19:08:34,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:34,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:34,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:34,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:34,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:34,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:34,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:34,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:34,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:34,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:34,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:34,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:34,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:34,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:34,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:34,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:34,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:34,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:34,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:34,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:34,315 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02475216978299489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037088180177334694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02475216978299489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,315 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-14 19:08:34,316 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01645362977264333, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02475216978299489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037088180177334694, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02475216978299489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04875, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-14 19:08:34,463 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 221 ms to try 5000 different iterations.  Found a solution that moves 1034 regions; Going from a computed imbalance of 0.01645362977264333 to a new imbalance of 8.76069726327063E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01169189192134176); MoveCostFunction : (multiplier=7.0, imbalance=0.11488888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,465 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2144418277:81 , srv1279831783:82 , srv1520237125:82 , srv1949012362:82 , srv562850614:82 , srv1151002841:83 , srv1263300830:83 , srv1636668258:83 , srv1666779023:83 , srv574990756:83 , srv652957747:83 , srv1356212516:84 , srv138921240:84 , srv1495522827:84 , srv1765930144:84 , srv1818067205:84 , srv186037912:84 , srv2025380748:84 , srv290097825:84 , srv296349689:84 , srv344319430:84 , srv571053507:84 , srv578040091:84 , srv736240400:84 , srv1002046997:85 , srv1271774209:85 , srv1328789194:85 , srv1427068543:85 , srv1471942407:85 , srv167592952:85 , srv1702907980:85 , srv1766981544:85 , srv17695690:85 , srv1866691097:85 , srv2017171654:85 , srv2043228829:85 , srv221977410:85 , srv280186183:85 , srv423831441:85 , srv575448552:85 , srv726859075:85 , srv800587198:85 , srv832304271:85 , srv902315425:85 , srv941398666:85 , srv957637200:85 , srv1066964527:86 , srv1166611808:86 , srv125615377:86 , srv1433687475:86 , srv1552403062:86 , srv1651225466:86 , srv1721245549:86 , srv1723043554:86 , srv1740307933:86 , srv1779576573:86 , srv1918470730:86 , srv2077023316:86 , srv2115558498:86 , srv2117796342:86 , srv2143474024:86 , srv222298808:86 , srv304054152:86 , srv532058886:86 , srv582672194:86 , srv613855629:86 , srv72497894:86 , srv7263454:86 , srv843508119:86 , srv876695807:86 , srv944893791:86 , srv1065580368:87 , srv1105338781:87 , srv1156685892:87 , srv1189059510:87 , srv139044730:87 , srv1607725606:87 , srv1644928615:87 , srv1771217335:87 , srv1872292029:87 , srv1937123256:87 , srv2078265213:87 , srv2085829311:87 , srv546912380:87 , srv585603096:87 , srv712941009:87 , srv975643562:87 , srv1011683010:88 , srv1140013645:88 , srv1318985730:88 , srv1644077568:88 , srv1666310825:88 , srv305520918:88 , srv481074760:88 , srv614131662:88 , srv637736099:88 , srv1253187506:89 , srv290423734:89 , srv597772557:89 , srv484340950:530 }
2023-07-14 19:08:34,468 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:34,469 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:34,477 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:34,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:34,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:34,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:34,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:34,482 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:34,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:34,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:34,485 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:34,486 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:34,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:34,487 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:34,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01169189192134176); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,563 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-14 19:08:34,563 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.688295035786792E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007466097461068055); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01169189192134176); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007466097461068055); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.005333333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-14 19:08:34,821 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 326 ms to try 5000 different iterations.  Found a solution that moves 281 regions; Going from a computed imbalance of 8.688295035786792E-4 to a new imbalance of 5.814703770175658E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.03122222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,822 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1253187506:82 , srv1066964527:83 , srv1318985730:83 , srv1721245549:83 , srv1937123256:83 , srv290423734:83 , srv532058886:83 , srv571053507:83 , srv575448552:83 , srv597772557:83 , srv1105338781:84 , srv1156685892:84 , srv1166611808:84 , srv125615377:84 , srv1263300830:84 , srv1328789194:84 , srv138921240:84 , srv1433687475:84 , srv1636668258:84 , srv1644077568:84 , srv1666310825:84 , srv167592952:84 , srv1702907980:84 , srv1740307933:84 , srv1779576573:84 , srv1818067205:84 , srv1949012362:84 , srv2043228829:84 , srv2085829311:84 , srv2115558498:84 , srv304054152:84 , srv305520918:84 , srv344319430:84 , srv423831441:84 , srv546912380:84 , srv582672194:84 , srv585603096:84 , srv614131662:84 , srv637736099:84 , srv72497894:84 , srv7263454:84 , srv726859075:84 , srv736240400:84 , srv800587198:84 , srv1002046997:85 , srv1011683010:85 , srv1271774209:85 , srv1279831783:85 , srv1356212516:85 , srv139044730:85 , srv1427068543:85 , srv1471942407:85 , srv1607725606:85 , srv1644928615:85 , srv1723043554:85 , srv1766981544:85 , srv17695690:85 , srv1771217335:85 , srv186037912:85 , srv1866691097:85 , srv1872292029:85 , srv1918470730:85 , srv2017171654:85 , srv2025380748:85 , srv2077023316:85 , srv2078265213:85 , srv2117796342:85 , srv2143474024:85 , srv2144418277:85 , srv280186183:85 , srv290097825:85 , srv481074760:85 , srv574990756:85 , srv613855629:85 , srv712941009:85 , srv832304271:85 , srv876695807:85 , srv902315425:85 , srv941398666:85 , srv957637200:85 , srv975643562:85 , srv1065580368:86 , srv1140013645:86 , srv1189059510:86 , srv1495522827:86 , srv1520237125:86 , srv1552403062:86 , srv1651225466:86 , srv1765930144:86 , srv221977410:86 , srv222298808:86 , srv296349689:86 , srv562850614:86 , srv843508119:86 , srv944893791:86 , srv1151002841:87 , srv1666779023:87 , srv578040091:87 , srv652957747:87 , srv484340950:618 }
2023-07-14 19:08:34,828 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:34,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:34,841 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:34,842 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:34,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:34,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:34,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:34,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:34,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:34,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:34,932 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-07-14 19:08:34,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.617943364731186E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=5.0E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-07-14 19:08:35,091 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 237 ms to try 5000 different iterations.  Found a solution that moves 36 regions; Going from a computed imbalance of 5.617943364731186E-5 to a new imbalance of 6.650063060027741E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.004); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:35,092 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1065580368:83 , srv1140013645:83 , srv1151002841:83 , srv1427068543:83 , srv1433687475:83 , srv1651225466:83 , srv1666779023:83 , srv17695690:83 , srv296349689:83 , srv562850614:83 , srv578040091:83 , srv902315425:83 , srv1002046997:84 , srv1011683010:84 , srv1105338781:84 , srv1156685892:84 , srv1166611808:84 , srv1189059510:84 , srv1263300830:84 , srv1271774209:84 , srv1279831783:84 , srv1328789194:84 , srv1356212516:84 , srv138921240:84 , srv139044730:84 , srv1471942407:84 , srv1495522827:84 , srv1520237125:84 , srv1552403062:84 , srv1607725606:84 , srv1644077568:84 , srv1644928615:84 , srv167592952:84 , srv1702907980:84 , srv1723043554:84 , srv1740307933:84 , srv1765930144:84 , srv1766981544:84 , srv1771217335:84 , srv1779576573:84 , srv186037912:84 , srv1866691097:84 , srv1872292029:84 , srv1918470730:84 , srv1937123256:84 , srv1949012362:84 , srv2017171654:84 , srv2025380748:84 , srv2043228829:84 , srv2077023316:84 , srv2078265213:84 , srv2085829311:84 , srv2115558498:84 , srv2117796342:84 , srv2143474024:84 , srv221977410:84 , srv222298808:84 , srv280186183:84 , srv290423734:84 , srv304054152:84 , srv305520918:84 , srv344319430:84 , srv423831441:84 , srv481074760:84 , srv532058886:84 , srv546912380:84 , srv574990756:84 , srv575448552:84 , srv582672194:84 , srv585603096:84 , srv597772557:84 , srv613855629:84 , srv614131662:84 , srv637736099:84 , srv652957747:84 , srv712941009:84 , srv72497894:84 , srv7263454:84 , srv726859075:84 , srv736240400:84 , srv832304271:84 , srv843508119:84 , srv876695807:84 , srv941398666:84 , srv944893791:84 , srv957637200:84 , srv975643562:84 , srv1066964527:85 , srv1253187506:85 , srv125615377:85 , srv1318985730:85 , srv1636668258:85 , srv1666310825:85 , srv1721245549:85 , srv1818067205:85 , srv2144418277:85 , srv290097825:85 , srv571053507:85 , srv800587198:85 , srv484340950:684 }
2023-07-14 19:08:35,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:35,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1771217335=41, srv1949012362=49, srv1666310825=31, srv1866691097=45, srv290097825=63, srv574990756=76, srv1918470730=47, srv578040091=78, srv1471942407=22, srv843508119=93, srv72497894=87, srv2017171654=50, srv1552403062=25, srv305520918=67, srv876695807=94, srv1279831783=14, srv575448552=77, srv546912380=73, srv585603096=80, srv484340950=71, srv975643562=99, srv2143474024=58, srv7263454=88, srv1765930144=38, srv957637200=98, srv726859075=89, srv1166611808=8, srv423831441=69, srv941398666=96, srv2025380748=51, srv582672194=79, srv138921240=18, srv2115558498=56, srv1140013645=5, srv1779576573=42, srv1105338781=4, srv1651225466=30, srv736240400=90, srv2043228829=52, srv222298808=61, srv304054152=66, srv125615377=11, srv1666779023=32, srv1263300830=12, srv2085829311=55, srv2117796342=57, srv1702907980=34, srv290423734=64, srv614131662=83, srv1520237125=24, srv1872292029=46, srv2144418277=59, srv1066964527=3, srv1433687475=21, srv1253187506=10, srv1644928615=29, srv944893791=97, srv481074760=70, srv902315425=95, srv613855629=82, srv1271774209=13, srv1189059510=9, srv1318985730=15, srv186037912=44, srv280186183=62, srv1607725606=26, srv1002046997=0, srv1740307933=37, srv532058886=72, srv139044730=19, srv1818067205=43, srv562850614=74, srv17695690=40, srv652957747=85, srv1011683010=1, srv1723043554=36, srv221977410=60, srv296349689=65, srv637736099=84, srv1721245549=35, srv1766981544=39, srv344319430=68, srv1328789194=16, srv800587198=91, srv1937123256=48, srv1636668258=27, srv167592952=33, srv571053507=75, srv1427068543=20, srv1151002841=6, srv1644077568=28, srv2078265213=54, srv1495522827=23, srv1065580368=2, srv712941009=86, srv1156685892=7, srv2077023316=53, srv832304271=92, srv1356212516=17, srv597772557=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:35,108 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:35,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-07-14 19:08:35,110 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-07-14 19:08:35,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-07-14 19:08:35,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-07-14 19:08:35,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-07-14 19:08:35,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-07-14 19:08:35,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-07-14 19:08:35,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-07-14 19:08:35,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-07-14 19:08:35,208 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:35,209 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1065580368:83 , srv1140013645:83 , srv1151002841:83 , srv1427068543:83 , srv1433687475:83 , srv1651225466:83 , srv1666779023:83 , srv17695690:83 , srv296349689:83 , srv562850614:83 , srv578040091:83 , srv902315425:83 , srv1002046997:84 , srv1011683010:84 , srv1105338781:84 , srv1156685892:84 , srv1166611808:84 , srv1189059510:84 , srv1263300830:84 , srv1271774209:84 , srv1279831783:84 , srv1328789194:84 , srv1356212516:84 , srv138921240:84 , srv139044730:84 , srv1471942407:84 , srv1495522827:84 , srv1520237125:84 , srv1552403062:84 , srv1607725606:84 , srv1644077568:84 , srv1644928615:84 , srv167592952:84 , srv1702907980:84 , srv1723043554:84 , srv1740307933:84 , srv1765930144:84 , srv1766981544:84 , srv1771217335:84 , srv1779576573:84 , srv186037912:84 , srv1866691097:84 , srv1872292029:84 , srv1918470730:84 , srv1937123256:84 , srv1949012362:84 , srv2017171654:84 , srv2025380748:84 , srv2043228829:84 , srv2077023316:84 , srv2078265213:84 , srv2085829311:84 , srv2115558498:84 , srv2117796342:84 , srv2143474024:84 , srv221977410:84 , srv222298808:84 , srv280186183:84 , srv290423734:84 , srv304054152:84 , srv305520918:84 , srv344319430:84 , srv423831441:84 , srv481074760:84 , srv532058886:84 , srv546912380:84 , srv574990756:84 , srv575448552:84 , srv582672194:84 , srv585603096:84 , srv597772557:84 , srv613855629:84 , srv614131662:84 , srv637736099:84 , srv652957747:84 , srv712941009:84 , srv72497894:84 , srv7263454:84 , srv726859075:84 , srv736240400:84 , srv832304271:84 , srv843508119:84 , srv876695807:84 , srv941398666:84 , srv944893791:84 , srv957637200:84 , srv975643562:84 , srv1066964527:85 , srv1253187506:85 , srv125615377:85 , srv1318985730:85 , srv1636668258:85 , srv1666310825:85 , srv1721245549:85 , srv1818067205:85 , srv2144418277:85 , srv290097825:85 , srv571053507:85 , srv800587198:85 , srv484340950:684 }
2023-07-14 19:08:35,239 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 204), ProcessCount=170 (was 170), AvailableMemoryMB=6521 (was 6753)
2023-07-14 19:08:35,248 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=170, AvailableMemoryMB=6520
2023-07-14 19:08:35,249 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-07-14 19:08:35,249 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-07-14 19:08:35,260 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1069298468:84 , srv1183649122:84 , srv1254147127:84 , srv1416180818:84 , srv1417828367:84 , srv1527218136:84 , srv1644827211:84 , srv1694130112:84 , srv1696986997:84 , srv1704063014:84 , srv1718368820:84 , srv1867659672:84 , srv1920700184:84 , srv1942367284:84 , srv194545331:84 , srv2017047934:84 , srv2102859462:84 , srv21994714:84 , srv349534213:84 , srv483730391:84 , srv517109029:84 , srv555796058:84 , srv563004130:84 , srv60890405:84 , srv669242314:84 , srv772262559:84 , srv817985244:84 , srv867352616:84 , srv903675700:84 , srv2143468314:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-07-14 19:08:35,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:08:35,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1069298468=0, srv483730391=20, srv772262559=26, srv1718368820=10, srv2102859462=16, srv60890405=24, srv1527218136=5, srv517109029=21, srv563004130=23, srv867352616=28, srv1644827211=6, srv1920700184=12, srv1867659672=11, srv2017047934=15, srv1416180818=3, srv903675700=29, srv349534213=19, srv1417828367=4, srv2143468314=17, srv1942367284=13, srv1183649122=1, srv1694130112=7, srv555796058=22, srv194545331=14, srv817985244=27, srv21994714=18, srv1254147127=2, srv1704063014=9, srv1696986997=8, srv669242314=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:08:35,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:08:35,273 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:08:35,274 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-14 19:08:35,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1744686931544415, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:08:35,297 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912742788419481, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1744686931544415, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-07-14 19:10:35,278 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 11071183 different iterations.  Found a solution that moves 1840 regions; Going from a computed imbalance of 0.9912742788419481 to a new imbalance of 4.2946517914333035E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6814814814814815, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:10:35,285 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1069298468:90 , srv1183649122:90 , srv1254147127:90 , srv1416180818:90 , srv1417828367:90 , srv1527218136:90 , srv1644827211:90 , srv1694130112:90 , srv1696986997:90 , srv1704063014:90 , srv1718368820:90 , srv1867659672:90 , srv1920700184:90 , srv1942367284:90 , srv194545331:90 , srv2017047934:90 , srv2102859462:90 , srv2143468314:90 , srv21994714:90 , srv349534213:90 , srv483730391:90 , srv517109029:90 , srv555796058:90 , srv563004130:90 , srv60890405:90 , srv669242314:90 , srv772262559:90 , srv817985244:90 , srv867352616:90 , srv903675700:90 }
2023-07-14 19:10:35,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-07-14 19:10:35,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1069298468=0, srv483730391=20, srv772262559=26, srv1718368820=10, srv2102859462=16, srv60890405=24, srv1527218136=5, srv517109029=21, srv563004130=23, srv867352616=28, srv1644827211=6, srv1920700184=12, srv1867659672=11, srv2017047934=15, srv1416180818=3, srv903675700=29, srv349534213=19, srv1417828367=4, srv2143468314=17, srv1942367284=13, srv1183649122=1, srv1694130112=7, srv555796058=22, srv194545331=14, srv817985244=27, srv21994714=18, srv1254147127=2, srv1704063014=9, srv1696986997=8, srv669242314=25} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-07-14 19:10:35,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-07-14 19:10:35,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-07-14 19:10:35,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-07-14 19:10:35,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-07-14 19:10:35,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-07-14 19:10:35,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-07-14 19:10:35,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-07-14 19:10:35,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-07-14 19:10:35,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-07-14 19:10:35,299 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-07-14 19:10:35,299 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1069298468:90 , srv1183649122:90 , srv1254147127:90 , srv1416180818:90 , srv1417828367:90 , srv1527218136:90 , srv1644827211:90 , srv1694130112:90 , srv1696986997:90 , srv1704063014:90 , srv1718368820:90 , srv1867659672:90 , srv1920700184:90 , srv1942367284:90 , srv194545331:90 , srv2017047934:90 , srv2102859462:90 , srv2143468314:90 , srv21994714:90 , srv349534213:90 , srv483730391:90 , srv517109029:90 , srv555796058:90 , srv563004130:90 , srv60890405:90 , srv669242314:90 , srv772262559:90 , srv817985244:90 , srv867352616:90 , srv903675700:90 }
2023-07-14 19:10:35,309 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 204), ProcessCount=166 (was 170), AvailableMemoryMB=6568 (was 6520) - AvailableMemoryMB LEAK? -