2023-05-25 08:53:22,937 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-25 08:53:23,216 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-25 08:53:23,314 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-25 08:53:23,369 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-25 08:53:23,375 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-25 08:53:23,388 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=172, AvailableMemoryMB=4569
2023-05-25 08:53:23,390 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-25 08:53:23,390 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-25 08:53:23,512 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1020432973:84 , srv1022763544:84 , srv1098221484:84 , srv1099312599:84 , srv1106220520:84 , srv1113462785:84 , srv1139590890:84 , srv1220637106:84 , srv1232274831:84 , srv1232508770:84 , srv1235285539:84 , srv1246018704:84 , srv1281662475:84 , srv1305899842:84 , srv1312579313:84 , srv1354143792:84 , srv136956395:84 , srv1414652678:84 , srv1495382292:84 , srv1512332482:84 , srv1514217347:84 , srv1525992021:84 , srv15285411:84 , srv1551421882:84 , srv1569004191:84 , srv1575252097:84 , srv1603898751:84 , srv1612853466:84 , srv1615318103:84 , srv1627576754:84 , srv165111525:84 , srv1672935126:84 , srv1684727089:84 , srv1692984196:84 , srv1708514447:84 , srv1754385591:84 , srv1764013917:84 , srv1784066315:84 , srv1844231981:84 , srv1848025265:84 , srv190171904:84 , srv1920757300:84 , srv1942843481:84 , srv1946288604:84 , srv1970797769:84 , srv1973503537:84 , srv1985995401:84 , srv1989344157:84 , srv202772713:84 , srv2036303530:84 , srv2045499517:84 , srv2048942584:84 , srv2060009750:84 , srv2076146986:84 , srv2081332428:84 , srv2099183383:84 , srv2109821705:84 , srv2115544648:84 , srv236149021:84 , srv263970856:84 , srv264714781:84 , srv302667567:84 , srv31782755:84 , srv342796584:84 , srv352157992:84 , srv367210634:84 , srv376673532:84 , srv387907989:84 , srv402034299:84 , srv404459422:84 , srv419592698:84 , srv424956348:84 , srv455072342:84 , srv462088487:84 , srv46260683:84 , srv485529908:84 , srv511577358:84 , srv514827132:84 , srv524736973:84 , srv545215438:84 , srv590568845:84 , srv608471253:84 , srv615117868:84 , srv622224510:84 , srv624185545:84 , srv631812821:84 , srv654649322:84 , srv670365026:84 , srv695656639:84 , srv741567762:84 , srv760267195:84 , srv832602929:84 , srv860774091:84 , srv873574536:84 , srv91616634:84 , srv921434276:84 , srv933776559:84 , srv947429034:84 , srv971738592:84 , srv955075005:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-25 08:53:23,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:23,525 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:23,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:23,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:23,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:23,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:23,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:23,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:23,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:23,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:23,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:23,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:23,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:23,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:23,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:23,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:23,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:23,764 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-25 08:53:23,764 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-25 08:53:24,065 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 445 ms to try 5000 different iterations.  Found a solution that moves 4679 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18094528172017857. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03902669187412935, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062014443848116906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5198888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03902669187412935, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23766666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:24,075 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1946288604:82 , srv1106220520:83 , srv236149021:83 , srv302667567:83 , srv404459422:83 , srv622224510:83 , srv921434276:83 , srv1098221484:84 , srv1099312599:84 , srv1139590890:84 , srv1512332482:84 , srv1551421882:84 , srv1603898751:84 , srv1684727089:84 , srv1764013917:84 , srv342796584:84 , srv590568845:84 , srv670365026:84 , srv947429034:84 , srv1020432973:85 , srv1232274831:85 , srv1232508770:85 , srv1246018704:85 , srv1575252097:85 , srv1612853466:85 , srv1848025265:85 , srv1985995401:85 , srv2060009750:85 , srv2109821705:85 , srv263970856:85 , srv402034299:85 , srv419592698:85 , srv455072342:85 , srv741567762:85 , srv860774091:85 , srv933776559:85 , srv1022763544:86 , srv1113462785:86 , srv1220637106:86 , srv1235285539:86 , srv1305899842:86 , srv1414652678:86 , srv165111525:86 , srv1692984196:86 , srv1784066315:86 , srv190171904:86 , srv1989344157:86 , srv2036303530:86 , srv2076146986:86 , srv2099183383:86 , srv31782755:86 , srv367210634:86 , srv424956348:86 , srv615117868:86 , srv654649322:86 , srv91616634:86 , srv1354143792:87 , srv1495382292:87 , srv1627576754:87 , srv1973503537:87 , srv2115544648:87 , srv376673532:87 , srv545215438:87 , srv631812821:87 , srv695656639:87 , srv1281662475:88 , srv1312579313:88 , srv1514217347:88 , srv15285411:88 , srv1708514447:88 , srv1920757300:88 , srv2048942584:88 , srv2081332428:88 , srv387907989:88 , srv46260683:88 , srv511577358:88 , srv514827132:88 , srv624185545:88 , srv760267195:88 , srv832602929:88 , srv873574536:88 , srv136956395:89 , srv1569004191:89 , srv1754385591:89 , srv1844231981:89 , srv2045499517:89 , srv264714781:89 , srv352157992:89 , srv608471253:89 , srv971738592:89 , srv1615318103:90 , srv1672935126:90 , srv1970797769:90 , srv202772713:90 , srv462088487:90 , srv524736973:90 , srv1525992021:91 , srv1942843481:91 , srv485529908:96 , srv955075005:437 }
2023-05-25 08:53:24,078 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:24,079 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:24,094 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:24,095 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:24,096 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:24,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:24,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:24,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:24,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:24,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:24,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:24,101 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:24,211 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03902669187412935, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062014443848116906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03902669187412935, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23766666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:24,212 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-25 08:53:24,212 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1809125186619197, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03902669187412935, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062014443848116906, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03902669187412935, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17666666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23766666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-25 08:53:24,588 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 475 ms to try 5000 different iterations.  Found a solution that moves 2626 regions; Going from a computed imbalance of 0.1809125186619197 to a new imbalance of 0.013186442316056837. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021380816031581467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037458544238609566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2917777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021380816031581467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:24,603 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv485529908:77 , srv202772713:79 , srv1615318103:80 , srv524736973:80 , srv1942843481:81 , srv1281662475:82 , srv1525992021:82 , srv2048942584:82 , srv608471253:82 , srv1514217347:83 , srv15285411:83 , srv1627576754:83 , srv1672935126:83 , srv1970797769:83 , srv2076146986:83 , srv2115544648:83 , srv352157992:83 , srv514827132:83 , srv760267195:83 , srv1113462785:84 , srv1569004191:84 , srv165111525:84 , srv1708514447:84 , srv1754385591:84 , srv1844231981:84 , srv1989344157:84 , srv2045499517:84 , srv2081332428:84 , srv264714781:84 , srv367210634:84 , srv387907989:84 , srv402034299:84 , srv545215438:84 , srv971738592:84 , srv1220637106:85 , srv1305899842:85 , srv1312579313:85 , srv136956395:85 , srv1692984196:85 , srv190171904:85 , srv1920757300:85 , srv2099183383:85 , srv376673532:85 , srv462088487:85 , srv511577358:85 , srv695656639:85 , srv741567762:85 , srv832602929:85 , srv873574536:85 , srv91616634:85 , srv933776559:85 , srv1232274831:86 , srv1232508770:86 , srv1354143792:86 , srv1495382292:86 , srv1784066315:86 , srv1973503537:86 , srv2036303530:86 , srv424956348:86 , srv455072342:86 , srv46260683:86 , srv615117868:86 , srv624185545:86 , srv631812821:86 , srv654649322:86 , srv1098221484:87 , srv1235285539:87 , srv1246018704:87 , srv1414652678:87 , srv1551421882:87 , srv1575252097:87 , srv1985995401:87 , srv2060009750:87 , srv2109821705:87 , srv263970856:87 , srv31782755:87 , srv1020432973:88 , srv1099312599:88 , srv1603898751:88 , srv1764013917:88 , srv1848025265:88 , srv236149021:88 , srv419592698:88 , srv1022763544:89 , srv1139590890:89 , srv1612853466:89 , srv1684727089:89 , srv302667567:89 , srv590568845:89 , srv860774091:89 , srv947429034:89 , srv1106220520:90 , srv342796584:90 , srv404459422:90 , srv622224510:90 , srv921434276:90 , srv1946288604:91 , srv670365026:91 , srv1512332482:92 , srv955075005:527 }
2023-05-25 08:53:24,609 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:24,613 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:24,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:24,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:24,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:24,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:24,645 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:24,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:24,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:24,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:24,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:24,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:24,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:24,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021380816031581467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037458544238609566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021380816031581467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:24,783 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-25 08:53:24,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01316805467104982, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021380816031581467); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037458544238609566, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021380816031581467); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009833333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04491666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-25 08:53:25,093 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 1038 regions; Going from a computed imbalance of 0.01316805467104982 to a new imbalance of 8.101316992075746E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006440224633376166); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.11533333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006440224633376166); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:25,095 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1512332482:80 , srv1022763544:82 , srv670365026:82 , srv1612853466:83 , srv342796584:83 , srv1106220520:84 , srv1235285539:84 , srv1312579313:84 , srv136956395:84 , srv1672935126:84 , srv1684727089:84 , srv1708514447:84 , srv1754385591:84 , srv1844231981:84 , srv1848025265:84 , srv1920757300:84 , srv2045499517:84 , srv2081332428:84 , srv404459422:84 , srv462088487:84 , srv46260683:84 , srv511577358:84 , srv622224510:84 , srv624185545:84 , srv631812821:84 , srv860774091:84 , srv921434276:84 , srv947429034:84 , srv971738592:84 , srv1099312599:85 , srv1139590890:85 , srv1232508770:85 , srv1246018704:85 , srv1354143792:85 , srv1414652678:85 , srv1495382292:85 , srv1525992021:85 , srv1569004191:85 , srv1575252097:85 , srv1603898751:85 , srv1784066315:85 , srv1946288604:85 , srv1973503537:85 , srv1985995401:85 , srv2036303530:85 , srv2109821705:85 , srv263970856:85 , srv264714781:85 , srv302667567:85 , srv31782755:85 , srv352157992:85 , srv419592698:85 , srv485529908:85 , srv832602929:85 , srv873574536:85 , srv1020432973:86 , srv1098221484:86 , srv1232274831:86 , srv1514217347:86 , srv1551421882:86 , srv1692984196:86 , srv1764013917:86 , srv1942843481:86 , srv1970797769:86 , srv2060009750:86 , srv236149021:86 , srv376673532:86 , srv387907989:86 , srv455072342:86 , srv545215438:86 , srv590568845:86 , srv608471253:86 , srv615117868:86 , srv654649322:86 , srv695656639:86 , srv760267195:86 , srv91616634:86 , srv1220637106:87 , srv1305899842:87 , srv15285411:87 , srv1615318103:87 , srv1627576754:87 , srv165111525:87 , srv190171904:87 , srv1989344157:87 , srv2048942584:87 , srv2099183383:87 , srv2115544648:87 , srv402034299:87 , srv424956348:87 , srv514827132:87 , srv524736973:87 , srv741567762:87 , srv1113462785:88 , srv1281662475:88 , srv202772713:88 , srv367210634:88 , srv933776559:88 , srv2076146986:89 , srv955075005:551 }
2023-05-25 08:53:25,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:25,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:25,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:25,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:25,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:25,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:25,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:25,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:25,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:25,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006440224633376166); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006440224633376166); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:25,224 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-25 08:53:25,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.028634678605511E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006440224633376166); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0098016238147137); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006440224633376166); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=4.166666666666667E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-25 08:53:25,630 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 505 ms to try 5000 different iterations.  Found a solution that moves 273 regions; Going from a computed imbalance of 8.028634678605511E-4 to a new imbalance of 3.5871999217211484E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.030333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:25,631 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1020432973:83 , srv1235285539:83 , srv1970797769:83 , srv419592698:83 , srv424956348:83 , srv590568845:83 , srv615117868:83 , srv1113462785:84 , srv1139590890:84 , srv1220637106:84 , srv1246018704:84 , srv1305899842:84 , srv1312579313:84 , srv1354143792:84 , srv136956395:84 , srv1414652678:84 , srv1495382292:84 , srv1525992021:84 , srv15285411:84 , srv1551421882:84 , srv1569004191:84 , srv1764013917:84 , srv1942843481:84 , srv1946288604:84 , srv1973503537:84 , srv2060009750:84 , srv2076146986:84 , srv264714781:84 , srv31782755:84 , srv367210634:84 , srv376673532:84 , srv387907989:84 , srv462088487:84 , srv46260683:84 , srv485529908:84 , srv514827132:84 , srv624185545:84 , srv654649322:84 , srv695656639:84 , srv832602929:84 , srv873574536:84 , srv933776559:84 , srv1022763544:85 , srv1098221484:85 , srv1099312599:85 , srv1106220520:85 , srv1232274831:85 , srv1281662475:85 , srv1514217347:85 , srv1575252097:85 , srv1603898751:85 , srv1612853466:85 , srv1615318103:85 , srv1627576754:85 , srv165111525:85 , srv1672935126:85 , srv1684727089:85 , srv1692984196:85 , srv1708514447:85 , srv1754385591:85 , srv1784066315:85 , srv1844231981:85 , srv1848025265:85 , srv190171904:85 , srv1920757300:85 , srv1985995401:85 , srv1989344157:85 , srv2045499517:85 , srv2048942584:85 , srv2099183383:85 , srv2109821705:85 , srv2115544648:85 , srv236149021:85 , srv263970856:85 , srv302667567:85 , srv342796584:85 , srv352157992:85 , srv404459422:85 , srv455072342:85 , srv511577358:85 , srv524736973:85 , srv545215438:85 , srv608471253:85 , srv622224510:85 , srv631812821:85 , srv670365026:85 , srv741567762:85 , srv760267195:85 , srv91616634:85 , srv921434276:85 , srv947429034:85 , srv971738592:85 , srv1232508770:86 , srv1512332482:86 , srv202772713:86 , srv2036303530:86 , srv2081332428:86 , srv402034299:86 , srv860774091:86 , srv955075005:627 }
2023-05-25 08:53:25,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:25,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:25,646 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:25,647 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:25,648 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:25,649 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:25,650 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:25,651 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:25,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:25,756 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-25 08:53:25,756 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.396041236004634E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.994073055283275E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.002010075630518424); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.994073055283275E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-25 08:53:26,010 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 349 ms to try 5000 different iterations.  Found a solution that moves 28 regions; Going from a computed imbalance of 3.396041236004634E-5 to a new imbalance of 7.269299486807925E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.003111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:26,011 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv860774091:82 , srv1281662475:83 , srv190171904:83 , srv202772713:83 , srv2036303530:83 , srv2099183383:83 , srv462088487:83 , srv1020432973:84 , srv1022763544:84 , srv1098221484:84 , srv1099312599:84 , srv1106220520:84 , srv1113462785:84 , srv1139590890:84 , srv1220637106:84 , srv1232274831:84 , srv1232508770:84 , srv1305899842:84 , srv1354143792:84 , srv136956395:84 , srv1414652678:84 , srv1495382292:84 , srv1512332482:84 , srv1514217347:84 , srv1525992021:84 , srv15285411:84 , srv1569004191:84 , srv1575252097:84 , srv1603898751:84 , srv1612853466:84 , srv1615318103:84 , srv1627576754:84 , srv165111525:84 , srv1672935126:84 , srv1684727089:84 , srv1692984196:84 , srv1754385591:84 , srv1764013917:84 , srv1784066315:84 , srv1844231981:84 , srv1848025265:84 , srv1920757300:84 , srv1942843481:84 , srv1946288604:84 , srv1970797769:84 , srv1973503537:84 , srv1985995401:84 , srv1989344157:84 , srv2045499517:84 , srv2048942584:84 , srv2060009750:84 , srv2076146986:84 , srv2081332428:84 , srv2109821705:84 , srv2115544648:84 , srv236149021:84 , srv263970856:84 , srv264714781:84 , srv302667567:84 , srv31782755:84 , srv342796584:84 , srv352157992:84 , srv367210634:84 , srv376673532:84 , srv387907989:84 , srv402034299:84 , srv404459422:84 , srv424956348:84 , srv455072342:84 , srv46260683:84 , srv485529908:84 , srv511577358:84 , srv514827132:84 , srv524736973:84 , srv545215438:84 , srv590568845:84 , srv608471253:84 , srv622224510:84 , srv624185545:84 , srv631812821:84 , srv654649322:84 , srv670365026:84 , srv695656639:84 , srv741567762:84 , srv760267195:84 , srv832602929:84 , srv873574536:84 , srv91616634:84 , srv921434276:84 , srv933776559:84 , srv947429034:84 , srv971738592:84 , srv1246018704:85 , srv1312579313:85 , srv1551421882:85 , srv1708514447:85 , srv419592698:85 , srv615117868:85 , srv1235285539:86 , srv955075005:684 }
2023-05-25 08:53:26,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:26,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv485529908=75, srv873574536=93, srv1551421882=23, srv165111525=30, srv2060009750=52, srv387907989=67, srv2036303530=49, srv1099312599=3, srv1232274831=8, srv46260683=74, srv342796584=63, srv947429034=97, srv741567762=89, srv15285411=22, srv419592698=70, srv1784066315=37, srv402034299=68, srv955075005=98, srv2099183383=55, srv462088487=73, srv264714781=60, srv31782755=62, srv1113462785=5, srv1569004191=24, srv1764013917=36, srv511577358=76, srv1098221484=2, srv1305899842=13, srv1627576754=29, srv1512332482=19, srv263970856=59, srv1848025265=39, srv514827132=77, srv695656639=88, srv91616634=94, srv1989344157=47, srv631812821=85, srv1235285539=10, srv1139590890=6, srv1946288604=43, srv760267195=90, srv1106220520=4, srv1920757300=41, srv376673532=66, srv1022763544=1, srv933776559=96, srv455072342=72, srv1020432973=0, srv1232508770=9, srv654649322=86, srv1973503537=45, srv1985995401=46, srv2045499517=50, srv424956348=71, srv1672935126=31, srv1942843481=42, srv921434276=95, srv1612853466=27, srv404459422=69, srv202772713=48, srv1575252097=25, srv1281662475=12, srv236149021=58, srv670365026=87, srv2076146986=53, srv1970797769=44, srv1312579313=14, srv524736973=78, srv1220637106=7, srv1603898751=26, srv136956395=16, srv352157992=64, srv1692984196=33, srv2115544648=57, srv1525992021=21, srv1514217347=20, srv545215438=79, srv1246018704=11, srv2109821705=56, srv624185545=84, srv860774091=92, srv1684727089=32, srv2081332428=54, srv615117868=82, srv1354143792=15, srv971738592=99, srv190171904=40, srv1754385591=35, srv1844231981=38, srv832602929=91, srv590568845=80, srv1495382292=18, srv1615318103=28, srv1708514447=34, srv367210634=65, srv2048942584=51, srv622224510=83, srv302667567=61, srv608471253=81, srv1414652678=17} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:26,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:26,030 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-25 08:53:26,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-25 08:53:26,032 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-25 08:53:26,033 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-25 08:53:26,034 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-25 08:53:26,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-25 08:53:26,036 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-25 08:53:26,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-25 08:53:26,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-25 08:53:26,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-25 08:53:26,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-25 08:53:26,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-25 08:53:26,143 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:26,144 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv860774091:82 , srv1281662475:83 , srv190171904:83 , srv202772713:83 , srv2036303530:83 , srv2099183383:83 , srv462088487:83 , srv1020432973:84 , srv1022763544:84 , srv1098221484:84 , srv1099312599:84 , srv1106220520:84 , srv1113462785:84 , srv1139590890:84 , srv1220637106:84 , srv1232274831:84 , srv1232508770:84 , srv1305899842:84 , srv1354143792:84 , srv136956395:84 , srv1414652678:84 , srv1495382292:84 , srv1512332482:84 , srv1514217347:84 , srv1525992021:84 , srv15285411:84 , srv1569004191:84 , srv1575252097:84 , srv1603898751:84 , srv1612853466:84 , srv1615318103:84 , srv1627576754:84 , srv165111525:84 , srv1672935126:84 , srv1684727089:84 , srv1692984196:84 , srv1754385591:84 , srv1764013917:84 , srv1784066315:84 , srv1844231981:84 , srv1848025265:84 , srv1920757300:84 , srv1942843481:84 , srv1946288604:84 , srv1970797769:84 , srv1973503537:84 , srv1985995401:84 , srv1989344157:84 , srv2045499517:84 , srv2048942584:84 , srv2060009750:84 , srv2076146986:84 , srv2081332428:84 , srv2109821705:84 , srv2115544648:84 , srv236149021:84 , srv263970856:84 , srv264714781:84 , srv302667567:84 , srv31782755:84 , srv342796584:84 , srv352157992:84 , srv367210634:84 , srv376673532:84 , srv387907989:84 , srv402034299:84 , srv404459422:84 , srv424956348:84 , srv455072342:84 , srv46260683:84 , srv485529908:84 , srv511577358:84 , srv514827132:84 , srv524736973:84 , srv545215438:84 , srv590568845:84 , srv608471253:84 , srv622224510:84 , srv624185545:84 , srv631812821:84 , srv654649322:84 , srv670365026:84 , srv695656639:84 , srv741567762:84 , srv760267195:84 , srv832602929:84 , srv873574536:84 , srv91616634:84 , srv921434276:84 , srv933776559:84 , srv947429034:84 , srv971738592:84 , srv1246018704:85 , srv1312579313:85 , srv1551421882:85 , srv1708514447:85 , srv419592698:85 , srv615117868:85 , srv1235285539:86 , srv955075005:684 }
2023-05-25 08:53:26,166 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 272), ProcessCount=172 (was 172), AvailableMemoryMB=3978 (was 4569)
2023-05-25 08:53:26,173 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=172, AvailableMemoryMB=3977
2023-05-25 08:53:26,174 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-25 08:53:26,174 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-25 08:53:26,185 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1026356207:84 , srv1042385478:84 , srv1047755878:84 , srv1056996022:84 , srv1174366488:84 , srv1174677485:84 , srv1257597257:84 , srv1377397639:84 , srv1465397488:84 , srv1521033239:84 , srv1532919752:84 , srv1584156366:84 , srv1854380556:84 , srv1886160755:84 , srv1955600250:84 , srv391852387:84 , srv399794093:84 , srv422561203:84 , srv465741212:84 , srv473469149:84 , srv594348208:84 , srv726364522:84 , srv739872698:84 , srv778671924:84 , srv818332538:84 , srv857919703:84 , srv861380067:84 , srv913824821:84 , srv984942845:84 , srv533834126:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-25 08:53:26,187 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:53:26,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1886160755=13, srv1955600250=14, srv1257597257=6, srv1377397639=7, srv818332538=25, srv1532919752=10, srv1174366488=4, srv594348208=21, srv1521033239=9, srv1042385478=1, srv391852387=15, srv739872698=23, srv778671924=24, srv1465397488=8, srv913824821=28, srv726364522=22, srv533834126=20, srv857919703=26, srv1026356207=0, srv1056996022=3, srv465741212=18, srv399794093=16, srv473469149=19, srv1047755878=2, srv1854380556=12, srv861380067=27, srv1174677485=5, srv422561203=17, srv984942845=29, srv1584156366=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:53:26,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:53:26,201 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:53:26,202 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-25 08:53:26,220 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1212009685852689, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:53:26,221 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912574943558715, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1212009685852689, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-25 08:55:26,206 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5702560 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912574943558715 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:55:26,212 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1026356207:90 , srv1042385478:90 , srv1047755878:90 , srv1056996022:90 , srv1174366488:90 , srv1174677485:90 , srv1257597257:90 , srv1377397639:90 , srv1465397488:90 , srv1521033239:90 , srv1532919752:90 , srv1584156366:90 , srv1854380556:90 , srv1886160755:90 , srv1955600250:90 , srv391852387:90 , srv399794093:90 , srv422561203:90 , srv465741212:90 , srv473469149:90 , srv533834126:90 , srv594348208:90 , srv726364522:90 , srv739872698:90 , srv778671924:90 , srv818332538:90 , srv857919703:90 , srv861380067:90 , srv913824821:90 , srv984942845:90 }
2023-05-25 08:55:26,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-25 08:55:26,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1886160755=13, srv1955600250=14, srv1257597257=6, srv1377397639=7, srv818332538=25, srv1532919752=10, srv1174366488=4, srv594348208=21, srv1521033239=9, srv1042385478=1, srv391852387=15, srv739872698=23, srv778671924=24, srv1465397488=8, srv913824821=28, srv726364522=22, srv533834126=20, srv857919703=26, srv1026356207=0, srv1056996022=3, srv465741212=18, srv399794093=16, srv473469149=19, srv1047755878=2, srv1854380556=12, srv861380067=27, srv1174677485=5, srv422561203=17, srv984942845=29, srv1584156366=11} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-25 08:55:26,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-25 08:55:26,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-25 08:55:26,229 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-25 08:55:26,229 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1026356207:90 , srv1042385478:90 , srv1047755878:90 , srv1056996022:90 , srv1174366488:90 , srv1174677485:90 , srv1257597257:90 , srv1377397639:90 , srv1465397488:90 , srv1521033239:90 , srv1532919752:90 , srv1584156366:90 , srv1854380556:90 , srv1886160755:90 , srv1955600250:90 , srv391852387:90 , srv399794093:90 , srv422561203:90 , srv465741212:90 , srv473469149:90 , srv533834126:90 , srv594348208:90 , srv726364522:90 , srv739872698:90 , srv778671924:90 , srv818332538:90 , srv857919703:90 , srv861380067:90 , srv913824821:90 , srv984942845:90 }
2023-05-25 08:55:26,241 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 272), ProcessCount=172 (was 172), AvailableMemoryMB=3939 (was 3977)