2023-08-30 07:53:09,953 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-30 07:53:10,274 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-30 07:53:10,398 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-30 07:53:10,463 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-30 07:53:10,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-30 07:53:10,486 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=171, AvailableMemoryMB=12900
2023-08-30 07:53:10,488 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-30 07:53:10,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-30 07:53:10,637 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1094257682:84 , srv111368517:84 , srv1117161133:84 , srv113747260:84 , srv114579482:84 , srv1147819688:84 , srv1166405430:84 , srv1170401234:84 , srv1203662080:84 , srv1225815129:84 , srv1277006490:84 , srv1287422593:84 , srv1317618589:84 , srv1340316364:84 , srv1340915881:84 , srv1359419424:84 , srv1359440071:84 , srv1370331712:84 , srv1404759935:84 , srv1405466913:84 , srv1406221676:84 , srv1409870589:84 , srv1415121743:84 , srv1436342375:84 , srv1447744865:84 , srv1456364644:84 , srv1463443113:84 , srv1504910751:84 , srv1517186074:84 , srv1573955616:84 , srv1607793885:84 , srv1659227915:84 , srv1672122931:84 , srv1692267879:84 , srv1697017281:84 , srv1701334041:84 , srv1717547249:84 , srv1725349182:84 , srv1760158832:84 , srv1783154931:84 , srv1788252555:84 , srv186927966:84 , srv1912078002:84 , srv192989010:84 , srv19372715:84 , srv1962571477:84 , srv1963703801:84 , srv2007159332:84 , srv2038898679:84 , srv2042222726:84 , srv2052193884:84 , srv2066556219:84 , srv220195886:84 , srv240896519:84 , srv253818265:84 , srv286364927:84 , srv304719274:84 , srv323524312:84 , srv325312263:84 , srv333333527:84 , srv355834476:84 , srv387392760:84 , srv395574713:84 , srv415438946:84 , srv432093494:84 , srv443372421:84 , srv464658005:84 , srv479900871:84 , srv499392386:84 , srv508649125:84 , srv512084424:84 , srv536387836:84 , srv538882494:84 , srv551600031:84 , srv563898029:84 , srv574822234:84 , srv582726208:84 , srv589337218:84 , srv616947508:84 , srv625366115:84 , srv640857359:84 , srv653527774:84 , srv654001936:84 , srv660712238:84 , srv699966844:84 , srv714979856:84 , srv742679181:84 , srv750780072:84 , srv772889774:84 , srv782759773:84 , srv787799255:84 , srv826040795:84 , srv86340231:84 , srv919320910:84 , srv932961238:84 , srv945899147:84 , srv97518584:84 , srv987539639:84 , srv988488890:84 , srv321616916:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-30 07:53:10,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:10,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:10,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:10,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:10,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:10,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:10,731 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:10,732 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:10,733 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:10,734 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:10,735 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:10,736 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:10,737 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:10,738 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:10,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:10,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:10,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:10,740 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:10,936 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:10,937 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-30 07:53:10,937 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-30 07:53:11,281 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 511 ms to try 5000 different iterations.  Found a solution that moves 4716 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17388923219122676. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03612824423046264, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057528600216528614, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.524, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03612824423046264, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.169, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:11,291 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1672122931:80 , srv2007159332:80 , srv464658005:82 , srv750780072:82 , srv1692267879:83 , srv2038898679:83 , srv113747260:84 , srv1225815129:84 , srv1359440071:84 , srv1405466913:84 , srv1717547249:84 , srv186927966:84 , srv19372715:84 , srv333333527:84 , srv479900871:84 , srv787799255:84 , srv1170401234:85 , srv1409870589:85 , srv1415121743:85 , srv1463443113:85 , srv1517186074:85 , srv1725349182:85 , srv1760158832:85 , srv220195886:85 , srv286364927:85 , srv443372421:85 , srv616947508:85 , srv699966844:85 , srv919320910:85 , srv1340316364:86 , srv1340915881:86 , srv1447744865:86 , srv1788252555:86 , srv1962571477:86 , srv1963703801:86 , srv2066556219:86 , srv325312263:86 , srv395574713:86 , srv499392386:86 , srv654001936:86 , srv660712238:86 , srv772889774:86 , srv111368517:87 , srv1117161133:87 , srv1277006490:87 , srv1287422593:87 , srv1317618589:87 , srv1359419424:87 , srv1406221676:87 , srv1436342375:87 , srv1456364644:87 , srv1504910751:87 , srv1659227915:87 , srv1701334041:87 , srv192989010:87 , srv240896519:87 , srv253818265:87 , srv323524312:87 , srv551600031:87 , srv563898029:87 , srv625366115:87 , srv826040795:87 , srv932961238:87 , srv945899147:87 , srv1166405430:88 , srv1203662080:88 , srv1370331712:88 , srv1404759935:88 , srv1573955616:88 , srv1607793885:88 , srv1912078002:88 , srv2052193884:88 , srv355834476:88 , srv387392760:88 , srv574822234:88 , srv589337218:88 , srv640857359:88 , srv714979856:88 , srv782759773:88 , srv86340231:88 , srv97518584:88 , srv1147819688:89 , srv1783154931:89 , srv415438946:89 , srv432093494:89 , srv536387836:89 , srv742679181:89 , srv987539639:89 , srv114579482:90 , srv1697017281:90 , srv304719274:90 , srv512084424:90 , srv582726208:90 , srv2042222726:91 , srv538882494:91 , srv1094257682:92 , srv988488890:92 , srv653527774:93 , srv508649125:94 , srv321616916:411 }
2023-08-30 07:53:11,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:11,296 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:11,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:11,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:11,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:11,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:11,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:11,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:11,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:11,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:11,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:11,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:11,448 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03612824423046264, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057528600216528614, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03612824423046264, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.169, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:11,448 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-30 07:53:11,448 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17385621005343044, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03612824423046264, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.057528600216528614, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03612824423046264, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.169, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23633333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-30 07:53:11,761 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 413 ms to try 5000 different iterations.  Found a solution that moves 2609 regions; Going from a computed imbalance of 0.17385621005343044 to a new imbalance of 0.015143342485876595. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019049623110862807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304589876769519, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28988888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019049623110862807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:11,774 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv508649125:79 , srv114579482:80 , srv653527774:80 , srv304719274:81 , srv1094257682:82 , srv512084424:82 , srv538882494:82 , srv582726208:82 , srv589337218:82 , srv625366115:82 , srv714979856:82 , srv742679181:82 , srv1573955616:83 , srv1697017281:83 , srv2042222726:83 , srv240896519:83 , srv325312263:83 , srv415438946:83 , srv640857359:83 , srv1147819688:84 , srv1166405430:84 , srv1317618589:84 , srv1359419424:84 , srv1370331712:84 , srv1404759935:84 , srv1659227915:84 , srv192989010:84 , srv2052193884:84 , srv286364927:84 , srv432093494:84 , srv551600031:84 , srv97518584:84 , srv111368517:85 , srv1203662080:85 , srv1277006490:85 , srv1287422593:85 , srv1436342375:85 , srv1456364644:85 , srv1504910751:85 , srv1783154931:85 , srv1788252555:85 , srv1962571477:85 , srv387392760:85 , srv536387836:85 , srv574822234:85 , srv654001936:85 , srv988488890:85 , srv1170401234:86 , srv1340915881:86 , srv1415121743:86 , srv1447744865:86 , srv1463443113:86 , srv1607793885:86 , srv186927966:86 , srv1912078002:86 , srv1963703801:86 , srv253818265:86 , srv323524312:86 , srv479900871:86 , srv699966844:86 , srv772889774:86 , srv782759773:86 , srv787799255:86 , srv826040795:86 , srv945899147:86 , srv987539639:86 , srv1340316364:87 , srv1359440071:87 , srv1409870589:87 , srv1701334041:87 , srv333333527:87 , srv355834476:87 , srv395574713:87 , srv443372421:87 , srv563898029:87 , srv660712238:87 , srv86340231:87 , srv919320910:87 , srv932961238:87 , srv113747260:88 , srv1405466913:88 , srv1406221676:88 , srv1517186074:88 , srv1760158832:88 , srv2038898679:88 , srv220195886:88 , srv499392386:88 , srv1692267879:89 , srv1717547249:89 , srv1725349182:89 , srv2066556219:89 , srv616947508:89 , srv750780072:89 , srv1117161133:90 , srv1225815129:90 , srv1672122931:90 , srv19372715:90 , srv2007159332:90 , srv464658005:91 , srv321616916:532 }
2023-08-30 07:53:11,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:11,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:11,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:11,802 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:11,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:11,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:11,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:11,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:11,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:11,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:11,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:11,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:11,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:11,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:11,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:11,973 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019049623110862807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304589876769519, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019049623110862807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:11,973 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-30 07:53:11,973 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015125073877413797, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.019049623110862807); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03304589876769519, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.019049623110862807); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0445, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-30 07:53:12,348 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 509 ms to try 5000 different iterations.  Found a solution that moves 1007 regions; Going from a computed imbalance of 0.015125073877413797 to a new imbalance of 8.389111060304987E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.11188888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:12,350 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1117161133:81 , srv1406221676:82 , srv2066556219:82 , srv355834476:82 , srv86340231:82 , srv988488890:82 , srv1094257682:83 , srv19372715:83 , srv536387836:83 , srv616947508:83 , srv987539639:83 , srv1147819688:84 , srv1203662080:84 , srv1225815129:84 , srv1340316364:84 , srv1607793885:84 , srv1701334041:84 , srv1725349182:84 , srv1912078002:84 , srv2042222726:84 , srv323524312:84 , srv395574713:84 , srv432093494:84 , srv499392386:84 , srv508649125:84 , srv538882494:84 , srv563898029:84 , srv574822234:84 , srv782759773:84 , srv826040795:84 , srv932961238:84 , srv945899147:84 , srv1277006490:85 , srv1287422593:85 , srv1340915881:85 , srv1370331712:85 , srv1409870589:85 , srv1436342375:85 , srv1456364644:85 , srv1504910751:85 , srv1517186074:85 , srv1692267879:85 , srv1697017281:85 , srv1717547249:85 , srv1760158832:85 , srv1783154931:85 , srv1963703801:85 , srv2052193884:85 , srv220195886:85 , srv253818265:85 , srv387392760:85 , srv464658005:85 , srv653527774:85 , srv660712238:85 , srv772889774:85 , srv919320910:85 , srv111368517:86 , srv113747260:86 , srv1166405430:86 , srv1170401234:86 , srv1359419424:86 , srv1404759935:86 , srv1405466913:86 , srv1447744865:86 , srv1463443113:86 , srv1573955616:86 , srv1962571477:86 , srv2038898679:86 , srv240896519:86 , srv304719274:86 , srv333333527:86 , srv443372421:86 , srv512084424:86 , srv582726208:86 , srv640857359:86 , srv699966844:86 , srv742679181:86 , srv97518584:86 , srv1317618589:87 , srv1359440071:87 , srv1415121743:87 , srv1659227915:87 , srv1788252555:87 , srv186927966:87 , srv192989010:87 , srv2007159332:87 , srv415438946:87 , srv551600031:87 , srv654001936:87 , srv787799255:87 , srv114579482:88 , srv1672122931:88 , srv286364927:88 , srv325312263:88 , srv479900871:88 , srv589337218:88 , srv714979856:88 , srv750780072:88 , srv625366115:89 , srv321616916:561 }
2023-08-30 07:53:12,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:12,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:12,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:12,374 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:12,375 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:12,376 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:12,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:12,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:12,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:12,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:12,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:12,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:12,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:12,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:12,505 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:12,505 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-30 07:53:12,506 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.318599413229337E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005204389640497334); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007565649822656163); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005204389640497334); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004416666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-30 07:53:12,875 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 470 ms to try 5000 different iterations.  Found a solution that moves 282 regions; Going from a computed imbalance of 8.318599413229337E-4 to a new imbalance of 2.9494857606538532E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.03133333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:12,876 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv111368517:83 , srv1225815129:83 , srv1783154931:83 , srv582726208:83 , srv589337218:83 , srv97518584:83 , srv988488890:83 , srv1117161133:84 , srv113747260:84 , srv1147819688:84 , srv1166405430:84 , srv1317618589:84 , srv1340316364:84 , srv1359419424:84 , srv1359440071:84 , srv1404759935:84 , srv1415121743:84 , srv1447744865:84 , srv1517186074:84 , srv1607793885:84 , srv1659227915:84 , srv1672122931:84 , srv1692267879:84 , srv1697017281:84 , srv1701334041:84 , srv1717547249:84 , srv1725349182:84 , srv1760158832:84 , srv1912078002:84 , srv192989010:84 , srv2042222726:84 , srv286364927:84 , srv387392760:84 , srv415438946:84 , srv432093494:84 , srv479900871:84 , srv499392386:84 , srv512084424:84 , srv551600031:84 , srv625366115:84 , srv640857359:84 , srv653527774:84 , srv654001936:84 , srv660712238:84 , srv714979856:84 , srv750780072:84 , srv782759773:84 , srv86340231:84 , srv932961238:84 , srv987539639:84 , srv1094257682:85 , srv114579482:85 , srv1170401234:85 , srv1203662080:85 , srv1277006490:85 , srv1287422593:85 , srv1340915881:85 , srv1370331712:85 , srv1405466913:85 , srv1406221676:85 , srv1409870589:85 , srv1436342375:85 , srv1456364644:85 , srv1463443113:85 , srv1504910751:85 , srv1573955616:85 , srv1788252555:85 , srv186927966:85 , srv19372715:85 , srv1962571477:85 , srv2007159332:85 , srv2038898679:85 , srv2052193884:85 , srv2066556219:85 , srv220195886:85 , srv253818265:85 , srv304719274:85 , srv323524312:85 , srv325312263:85 , srv355834476:85 , srv395574713:85 , srv443372421:85 , srv464658005:85 , srv508649125:85 , srv536387836:85 , srv538882494:85 , srv563898029:85 , srv574822234:85 , srv616947508:85 , srv699966844:85 , srv742679181:85 , srv772889774:85 , srv787799255:85 , srv826040795:85 , srv919320910:85 , srv1963703801:86 , srv240896519:86 , srv333333527:86 , srv945899147:86 , srv321616916:638 }
2023-08-30 07:53:12,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:12,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:12,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:12,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:12,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:12,896 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:12,897 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:12,898 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:12,899 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:12,900 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:12,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:12,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:12,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:12,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:12,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:12,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:12,903 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:12,904 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:12,905 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:13,044 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:13,044 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-30 07:53:13,045 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.7520251402433872E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0021711298242630987); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-30 07:53:13,401 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 485 ms to try 5000 different iterations.  Found a solution that moves 33 regions; Going from a computed imbalance of 2.7520251402433872E-5 to a new imbalance of 7.920492739128986E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0036666666666666666); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:13,401 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv114579482:83 , srv1405466913:83 , srv1788252555:83 , srv1963703801:83 , srv220195886:83 , srv253818265:83 , srv333333527:83 , srv415438946:83 , srv443372421:83 , srv464658005:83 , srv563898029:83 , srv750780072:83 , srv945899147:83 , srv1094257682:84 , srv1117161133:84 , srv113747260:84 , srv1166405430:84 , srv1170401234:84 , srv1203662080:84 , srv1277006490:84 , srv1287422593:84 , srv1317618589:84 , srv1340915881:84 , srv1359440071:84 , srv1370331712:84 , srv1404759935:84 , srv1406221676:84 , srv1409870589:84 , srv1415121743:84 , srv1436342375:84 , srv1447744865:84 , srv1456364644:84 , srv1463443113:84 , srv1504910751:84 , srv1517186074:84 , srv1573955616:84 , srv1607793885:84 , srv1659227915:84 , srv1672122931:84 , srv1697017281:84 , srv1701334041:84 , srv1717547249:84 , srv1725349182:84 , srv1760158832:84 , srv1783154931:84 , srv186927966:84 , srv1912078002:84 , srv192989010:84 , srv19372715:84 , srv1962571477:84 , srv2007159332:84 , srv2038898679:84 , srv2042222726:84 , srv2052193884:84 , srv2066556219:84 , srv240896519:84 , srv304719274:84 , srv323524312:84 , srv325312263:84 , srv355834476:84 , srv387392760:84 , srv395574713:84 , srv479900871:84 , srv499392386:84 , srv508649125:84 , srv512084424:84 , srv536387836:84 , srv538882494:84 , srv551600031:84 , srv574822234:84 , srv616947508:84 , srv625366115:84 , srv653527774:84 , srv654001936:84 , srv660712238:84 , srv699966844:84 , srv714979856:84 , srv742679181:84 , srv772889774:84 , srv782759773:84 , srv787799255:84 , srv826040795:84 , srv919320910:84 , srv932961238:84 , srv987539639:84 , srv988488890:84 , srv111368517:85 , srv1147819688:85 , srv1225815129:85 , srv1340316364:85 , srv1359419424:85 , srv1692267879:85 , srv286364927:85 , srv432093494:85 , srv582726208:85 , srv589337218:85 , srv640857359:85 , srv86340231:85 , srv97518584:85 , srv321616916:684 }
2023-08-30 07:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:13,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv987539639=98, srv563898029=75, srv945899147=96, srv1370331712=17, srv826040795=92, srv387392760=62, srv589337218=78, srv582726208=77, srv1692267879=33, srv1287422593=11, srv1659227915=31, srv699966844=85, srv787799255=91, srv97518584=97, srv1783154931=39, srv1456364644=25, srv220195886=52, srv538882494=73, srv464658005=67, srv1517186074=28, srv415438946=64, srv1405466913=19, srv1788252555=40, srv616947508=79, srv714979856=86, srv432093494=65, srv742679181=87, srv253818265=54, srv321616916=57, srv508649125=70, srv2052193884=50, srv536387836=72, srv1447744865=24, srv1760158832=38, srv1317618589=12, srv2038898679=48, srv304719274=56, srv355834476=61, srv1225815129=9, srv1963703801=46, srv772889774=89, srv1436342375=23, srv1607793885=30, srv625366115=80, srv1912078002=42, srv1203662080=8, srv1404759935=18, srv1094257682=0, srv113747260=3, srv2042222726=49, srv1409870589=21, srv512084424=71, srv1725349182=37, srv1697017281=34, srv653527774=82, srv1170401234=7, srv1340316364=13, srv2066556219=51, srv1701334041=35, srv1406221676=20, srv192989010=43, srv240896519=53, srv499392386=69, srv1463443113=26, srv1962571477=45, srv750780072=88, srv2007159332=47, srv782759773=90, srv1277006490=10, srv286364927=55, srv395574713=63, srv1340915881=14, srv932961238=95, srv333333527=60, srv1672122931=32, srv19372715=44, srv1415121743=22, srv323524312=58, srv186927966=41, srv1166405430=6, srv111368517=1, srv1717547249=36, srv574822234=76, srv1117161133=2, srv660712238=84, srv443372421=66, srv919320910=94, srv551600031=74, srv1147819688=5, srv1359419424=15, srv325312263=59, srv479900871=68, srv640857359=81, srv1359440071=16, srv988488890=99, srv1573955616=29, srv114579482=4, srv654001936=83, srv86340231=93, srv1504910751=27} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:13,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:13,425 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:13,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-30 07:53:13,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-30 07:53:13,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-30 07:53:13,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-30 07:53:13,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-30 07:53:13,548 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:13,549 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv114579482:83 , srv1405466913:83 , srv1788252555:83 , srv1963703801:83 , srv220195886:83 , srv253818265:83 , srv333333527:83 , srv415438946:83 , srv443372421:83 , srv464658005:83 , srv563898029:83 , srv750780072:83 , srv945899147:83 , srv1094257682:84 , srv1117161133:84 , srv113747260:84 , srv1166405430:84 , srv1170401234:84 , srv1203662080:84 , srv1277006490:84 , srv1287422593:84 , srv1317618589:84 , srv1340915881:84 , srv1359440071:84 , srv1370331712:84 , srv1404759935:84 , srv1406221676:84 , srv1409870589:84 , srv1415121743:84 , srv1436342375:84 , srv1447744865:84 , srv1456364644:84 , srv1463443113:84 , srv1504910751:84 , srv1517186074:84 , srv1573955616:84 , srv1607793885:84 , srv1659227915:84 , srv1672122931:84 , srv1697017281:84 , srv1701334041:84 , srv1717547249:84 , srv1725349182:84 , srv1760158832:84 , srv1783154931:84 , srv186927966:84 , srv1912078002:84 , srv192989010:84 , srv19372715:84 , srv1962571477:84 , srv2007159332:84 , srv2038898679:84 , srv2042222726:84 , srv2052193884:84 , srv2066556219:84 , srv240896519:84 , srv304719274:84 , srv323524312:84 , srv325312263:84 , srv355834476:84 , srv387392760:84 , srv395574713:84 , srv479900871:84 , srv499392386:84 , srv508649125:84 , srv512084424:84 , srv536387836:84 , srv538882494:84 , srv551600031:84 , srv574822234:84 , srv616947508:84 , srv625366115:84 , srv653527774:84 , srv654001936:84 , srv660712238:84 , srv699966844:84 , srv714979856:84 , srv742679181:84 , srv772889774:84 , srv782759773:84 , srv787799255:84 , srv826040795:84 , srv919320910:84 , srv932961238:84 , srv987539639:84 , srv988488890:84 , srv111368517:85 , srv1147819688:85 , srv1225815129:85 , srv1340316364:85 , srv1359419424:85 , srv1692267879:85 , srv286364927:85 , srv432093494:85 , srv582726208:85 , srv589337218:85 , srv640857359:85 , srv86340231:85 , srv97518584:85 , srv321616916:684 }
2023-08-30 07:53:13,576 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=12036 (was 12900)
2023-08-30 07:53:13,585 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=171, AvailableMemoryMB=12036
2023-08-30 07:53:13,585 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-30 07:53:13,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-30 07:53:13,598 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1070639976:84 , srv1081098919:84 , srv1215450878:84 , srv1312677944:84 , srv1363650823:84 , srv1398872497:84 , srv1432725499:84 , srv1473771275:84 , srv1520375945:84 , srv1616901380:84 , srv1695798370:84 , srv179592998:84 , srv18200764:84 , srv1833806755:84 , srv18461279:84 , srv1949614018:84 , srv1958869182:84 , srv2022030458:84 , srv2047384637:84 , srv2124146450:84 , srv445694395:84 , srv510768025:84 , srv55207604:84 , srv59931540:84 , srv688248392:84 , srv691481425:84 , srv706593411:84 , srv760217345:84 , srv849909341:84 , srv606089798:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-30 07:53:13,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:53:13,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1363650823=4, srv1520375945=8, srv760217345=28, srv1070639976=0, srv510768025=21, srv1432725499=6, srv2022030458=17, srv2124146450=19, srv445694395=20, srv59931540=23, srv1398872497=5, srv1958869182=16, srv1473771275=7, srv1949614018=15, srv18461279=14, srv18200764=12, srv179592998=11, srv688248392=25, srv606089798=24, srv1215450878=2, srv1695798370=10, srv691481425=26, srv55207604=22, srv706593411=27, srv849909341=29, srv2047384637=18, srv1312677944=3, srv1833806755=13, srv1616901380=9, srv1081098919=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:53:13,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:53:13,614 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:53:13,615 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:53:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:53:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:53:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:53:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:53:13,616 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-30 07:53:13,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0694640399580857, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:53:13,637 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991241192218598, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0694640399580857, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-30 07:55:13,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5646863 different iterations.  Found a solution that moves 1847 regions; Going from a computed imbalance of 0.991241192218598 to a new imbalance of 4.3109901406398434E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6840740740740741, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:55:13,627 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1070639976:90 , srv1081098919:90 , srv1215450878:90 , srv1312677944:90 , srv1363650823:90 , srv1398872497:90 , srv1432725499:90 , srv1473771275:90 , srv1520375945:90 , srv1616901380:90 , srv1695798370:90 , srv179592998:90 , srv18200764:90 , srv1833806755:90 , srv18461279:90 , srv1949614018:90 , srv1958869182:90 , srv2022030458:90 , srv2047384637:90 , srv2124146450:90 , srv445694395:90 , srv510768025:90 , srv55207604:90 , srv59931540:90 , srv606089798:90 , srv688248392:90 , srv691481425:90 , srv706593411:90 , srv760217345:90 , srv849909341:90 }
2023-08-30 07:55:13,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-30 07:55:13,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1363650823=4, srv1520375945=8, srv760217345=28, srv1070639976=0, srv510768025=21, srv1432725499=6, srv2022030458=17, srv2124146450=19, srv445694395=20, srv59931540=23, srv1398872497=5, srv1958869182=16, srv1473771275=7, srv1949614018=15, srv18461279=14, srv18200764=12, srv179592998=11, srv688248392=25, srv606089798=24, srv1215450878=2, srv1695798370=10, srv691481425=26, srv55207604=22, srv706593411=27, srv849909341=29, srv2047384637=18, srv1312677944=3, srv1833806755=13, srv1616901380=9, srv1081098919=1} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-30 07:55:13,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-30 07:55:13,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-30 07:55:13,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-30 07:55:13,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-30 07:55:13,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-30 07:55:13,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-30 07:55:13,649 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-30 07:55:13,649 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1070639976:90 , srv1081098919:90 , srv1215450878:90 , srv1312677944:90 , srv1363650823:90 , srv1398872497:90 , srv1432725499:90 , srv1473771275:90 , srv1520375945:90 , srv1616901380:90 , srv1695798370:90 , srv179592998:90 , srv18200764:90 , srv1833806755:90 , srv18461279:90 , srv1949614018:90 , srv1958869182:90 , srv2022030458:90 , srv2047384637:90 , srv2124146450:90 , srv445694395:90 , srv510768025:90 , srv55207604:90 , srv59931540:90 , srv606089798:90 , srv688248392:90 , srv691481425:90 , srv706593411:90 , srv760217345:90 , srv849909341:90 }
2023-08-30 07:55:13,662 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=138 (was 288), ProcessCount=173 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=12292 (was 12036) - AvailableMemoryMB LEAK? -