2023-05-09 10:53:35,583 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-09 10:53:35,934 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-09 10:53:36,054 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-09 10:53:36,126 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-09 10:53:36,137 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-09 10:53:36,149 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=175, AvailableMemoryMB=14095
2023-05-09 10:53:36,151 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-09 10:53:36,152 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-09 10:53:36,275 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1001057129:84 , srv1013312381:84 , srv1050112548:84 , srv1050578057:84 , srv1055871997:84 , srv108089440:84 , srv1090858044:84 , srv1096261795:84 , srv1116127342:84 , srv1129551783:84 , srv1132540374:84 , srv1165254812:84 , srv1196812677:84 , srv1223297050:84 , srv1232062225:84 , srv1253985133:84 , srv1300615743:84 , srv1324147104:84 , srv1330524900:84 , srv1362796590:84 , srv1403508453:84 , srv141649266:84 , srv1423029200:84 , srv1458660072:84 , srv1489638681:84 , srv149597360:84 , srv1519136017:84 , srv1545056905:84 , srv1570523661:84 , srv1576623938:84 , srv1632138160:84 , srv1666225102:84 , srv1677980700:84 , srv1713207029:84 , srv1736972434:84 , srv1771016454:84 , srv1774285694:84 , srv1795676898:84 , srv1799215526:84 , srv1809027764:84 , srv1818008930:84 , srv1841464037:84 , srv185671817:84 , srv1862243228:84 , srv1862385149:84 , srv1880862544:84 , srv1901578301:84 , srv1926583246:84 , srv1944964727:84 , srv1952622357:84 , srv195466895:84 , srv1996302706:84 , srv2008939655:84 , srv2009781797:84 , srv2046392758:84 , srv2068741469:84 , srv207734984:84 , srv2078671977:84 , srv2082332851:84 , srv208936447:84 , srv2124163478:84 , srv215550072:84 , srv225029429:84 , srv249035802:84 , srv25202102:84 , srv252254697:84 , srv255085044:84 , srv285828138:84 , srv292659911:84 , srv372818832:84 , srv373005641:84 , srv382945566:84 , srv393910203:84 , srv40698459:84 , srv437230654:84 , srv450541506:84 , srv46717276:84 , srv473287282:84 , srv478429764:84 , srv504292405:84 , srv517528374:84 , srv533013140:84 , srv577472934:84 , srv600324683:84 , srv602866656:84 , srv615245276:84 , srv620781765:84 , srv655873730:84 , srv67124375:84 , srv700390273:84 , srv758563650:84 , srv758702680:84 , srv774085209:84 , srv777334425:84 , srv795511325:84 , srv853995617:84 , srv873128808:84 , srv956057484:84 , srv998556676:84 , srv810024645:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-09 10:53:36,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:36,297 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1944964727=48, srv2068741469=55, srv2082332851=58, srv1090858044=6, srv1677980700=32, srv382945566=71, srv40698459=73, srv252254697=65, srv25202102=64, srv655873730=87, srv1116127342=8, srv1880862544=45, srv195466895=50, srv255085044=66, srv1632138160=30, srv1795676898=37, srv1713207029=33, srv1926583246=47, srv1736972434=34, srv700390273=89, srv1862385149=44, srv1165254812=11, srv1330524900=18, srv615245276=85, srv46717276=76, srv285828138=67, srv1423029200=22, srv2008939655=52, srv1545056905=27, srv108089440=5, srv1050578057=3, srv758563650=90, srv1403508453=20, srv2078671977=57, srv533013140=81, srv1300615743=16, srv450541506=75, srv372818832=69, srv1013312381=1, srv67124375=88, srv149597360=25, srv1771016454=35, srv208936447=59, srv1862243228=43, srv473287282=77, srv1132540374=10, srv1519136017=26, srv1324147104=17, srv1841464037=41, srv393910203=72, srv517528374=80, srv1055871997=4, srv504292405=79, srv1996302706=51, srv225029429=62, srv795511325=94, srv1799215526=38, srv437230654=74, srv873128808=97, srv1576623938=29, srv853995617=96, srv1232062225=14, srv2046392758=54, srv1570523661=28, srv2124163478=60, srv478429764=78, srv1129551783=9, srv1489638681=24, srv215550072=61, srv1253985133=15, srv1362796590=19, srv141649266=21, srv1050112548=2, srv207734984=56, srv577472934=82, srv620781765=86, srv602866656=84, srv1001057129=0, srv774085209=92, srv1196812677=12, srv600324683=83, srv292659911=68, srv373005641=70, srv1952622357=49, srv777334425=93, srv758702680=91, srv1458660072=23, srv1809027764=39, srv1666225102=31, srv1096261795=7, srv1223297050=13, srv1818008930=40, srv249035802=63, srv185671817=42, srv998556676=99, srv2009781797=53, srv1774285694=36, srv956057484=98, srv1901578301=46, srv810024645=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:36,390 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:36,391 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-09 10:53:36,392 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-09 10:53:36,393 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-09 10:53:36,394 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-09 10:53:36,395 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-09 10:53:36,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-09 10:53:36,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-09 10:53:36,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-09 10:53:36,604 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:36,605 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-09 10:53:36,606 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-09 10:53:36,932 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 513 ms to try 5000 different iterations.  Found a solution that moves 4648 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18399446580026851. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04088740054871886, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079348125016389, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5164444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04088740054871886, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24733333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:36,948 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1489638681:81 , srv533013140:81 , srv1362796590:82 , srv1795676898:82 , srv1818008930:82 , srv1901578301:82 , srv1996302706:82 , srv853995617:82 , srv1013312381:83 , srv1232062225:83 , srv1632138160:83 , srv615245276:83 , srv956057484:83 , srv108089440:84 , srv1129551783:84 , srv1570523661:84 , srv1677980700:84 , srv185671817:84 , srv249035802:84 , srv373005641:84 , srv437230654:84 , srv517528374:84 , srv67124375:84 , srv1050112548:85 , srv1055871997:85 , srv1090858044:85 , srv1116127342:85 , srv1196812677:85 , srv149597360:85 , srv1713207029:85 , srv1862385149:85 , srv1952622357:85 , srv2046392758:85 , srv2068741469:85 , srv2078671977:85 , srv208936447:85 , srv225029429:85 , srv292659911:85 , srv372818832:85 , srv600324683:85 , srv998556676:85 , srv1050578057:86 , srv1096261795:86 , srv1223297050:86 , srv1253985133:86 , srv1423029200:86 , srv1458660072:86 , srv1545056905:86 , srv1576623938:86 , srv1774285694:86 , srv1799215526:86 , srv1944964727:86 , srv195466895:86 , srv2009781797:86 , srv207734984:86 , srv255085044:86 , srv40698459:86 , srv478429764:86 , srv620781765:86 , srv758563650:86 , srv795511325:86 , srv1300615743:87 , srv1403508453:87 , srv141649266:87 , srv1771016454:87 , srv1809027764:87 , srv1841464037:87 , srv2082332851:87 , srv252254697:87 , srv46717276:87 , srv473287282:87 , srv504292405:87 , srv873128808:87 , srv1132540374:88 , srv1519136017:88 , srv1666225102:88 , srv1880862544:88 , srv2008939655:88 , srv2124163478:88 , srv382945566:88 , srv450541506:88 , srv777334425:88 , srv1324147104:89 , srv1736972434:89 , srv25202102:89 , srv655873730:89 , srv700390273:89 , srv774085209:89 , srv1001057129:90 , srv1165254812:90 , srv393910203:90 , srv577472934:90 , srv602866656:90 , srv215550072:91 , srv758702680:91 , srv1330524900:93 , srv1862243228:93 , srv1926583246:100 , srv285828138:100 , srv810024645:453 }
2023-05-09 10:53:36,951 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:36,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1944964727=48, srv2068741469=55, srv2082332851=58, srv1090858044=6, srv1677980700=32, srv382945566=71, srv40698459=73, srv252254697=65, srv25202102=64, srv655873730=87, srv1116127342=8, srv1880862544=45, srv195466895=50, srv255085044=66, srv1632138160=30, srv1795676898=37, srv1713207029=33, srv1926583246=47, srv1736972434=34, srv700390273=89, srv1862385149=44, srv1165254812=11, srv1330524900=18, srv615245276=85, srv46717276=76, srv285828138=67, srv1423029200=22, srv2008939655=52, srv1545056905=27, srv108089440=5, srv1050578057=3, srv758563650=90, srv1403508453=20, srv2078671977=57, srv533013140=81, srv1300615743=16, srv450541506=75, srv372818832=69, srv1013312381=1, srv67124375=88, srv149597360=25, srv1771016454=35, srv208936447=59, srv1862243228=43, srv473287282=77, srv1132540374=10, srv1519136017=26, srv1324147104=17, srv1841464037=41, srv393910203=72, srv517528374=80, srv1055871997=4, srv504292405=79, srv1996302706=51, srv225029429=62, srv795511325=94, srv1799215526=38, srv437230654=74, srv873128808=97, srv1576623938=29, srv853995617=96, srv1232062225=14, srv2046392758=54, srv1570523661=28, srv2124163478=60, srv478429764=78, srv1129551783=9, srv1489638681=24, srv215550072=61, srv1253985133=15, srv1362796590=19, srv141649266=21, srv1050112548=2, srv207734984=56, srv577472934=82, srv620781765=86, srv602866656=84, srv1001057129=0, srv774085209=92, srv1196812677=12, srv600324683=83, srv292659911=68, srv373005641=70, srv1952622357=49, srv777334425=93, srv758702680=91, srv1458660072=23, srv1809027764=39, srv1666225102=31, srv1096261795=7, srv1223297050=13, srv1818008930=40, srv249035802=63, srv185671817=42, srv998556676=99, srv2009781797=53, srv1774285694=36, srv956057484=98, srv1901578301=46, srv810024645=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:36,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:36,972 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:36,973 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:36,974 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:36,975 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-09 10:53:36,976 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-09 10:53:36,977 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-09 10:53:36,978 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-09 10:53:36,979 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-09 10:53:36,980 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-09 10:53:36,981 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-09 10:53:36,982 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-09 10:53:36,983 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-09 10:53:37,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04088740054871886, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079348125016389, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04088740054871886, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24733333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:37,117 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-09 10:53:37,117 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1839619198086491, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04088740054871886, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06079348125016389, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04088740054871886, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17908333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24733333333333332, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-09 10:53:37,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 415 ms to try 5000 different iterations.  Found a solution that moves 2664 regions; Going from a computed imbalance of 0.1839619198086491 to a new imbalance of 0.015612402388333073. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022157594012898914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03550501458394378, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.296, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022157594012898914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:37,425 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1926583246:72 , srv285828138:75 , srv1862243228:78 , srv758702680:79 , srv1330524900:80 , srv1001057129:81 , srv1165254812:81 , srv774085209:81 , srv1324147104:82 , srv215550072:82 , srv25202102:82 , srv393910203:82 , srv700390273:82 , srv1132540374:83 , srv1736972434:83 , srv2124163478:83 , srv602866656:83 , srv655873730:83 , srv1050578057:84 , srv1253985133:84 , srv1458660072:84 , srv1713207029:84 , srv1841464037:84 , srv252254697:84 , srv255085044:84 , srv450541506:84 , srv577472934:84 , srv777334425:84 , srv795511325:84 , srv1096261795:85 , srv1196812677:85 , srv1223297050:85 , srv1300615743:85 , srv1403508453:85 , srv141649266:85 , srv1519136017:85 , srv1944964727:85 , srv208936447:85 , srv292659911:85 , srv382945566:85 , srv40698459:85 , srv478429764:85 , srv1116127342:86 , srv1570523661:86 , srv1576623938:86 , srv1666225102:86 , srv1771016454:86 , srv1862385149:86 , srv1880862544:86 , srv195466895:86 , srv2008939655:86 , srv2068741469:86 , srv2078671977:86 , srv372818832:86 , srv373005641:86 , srv46717276:86 , srv473287282:86 , srv504292405:86 , srv600324683:86 , srv873128808:86 , srv1050112548:87 , srv108089440:87 , srv1423029200:87 , srv1545056905:87 , srv1774285694:87 , srv1809027764:87 , srv185671817:87 , srv2009781797:87 , srv2046392758:87 , srv2082332851:87 , srv437230654:87 , srv620781765:87 , srv758563650:87 , srv1055871997:88 , srv149597360:88 , srv1677980700:88 , srv1799215526:88 , srv1952622357:88 , srv207734984:88 , srv225029429:88 , srv517528374:88 , srv1090858044:89 , srv1129551783:89 , srv1632138160:89 , srv1996302706:89 , srv615245276:89 , srv67124375:89 , srv853995617:89 , srv998556676:89 , srv1013312381:90 , srv1795676898:90 , srv1818008930:90 , srv1901578301:90 , srv249035802:90 , srv956057484:90 , srv1232062225:91 , srv1489638681:91 , srv1362796590:92 , srv533013140:92 , srv810024645:518 }
2023-05-09 10:53:37,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:37,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1944964727=48, srv2068741469=55, srv2082332851=58, srv1090858044=6, srv1677980700=32, srv382945566=71, srv40698459=73, srv252254697=65, srv25202102=64, srv655873730=87, srv1116127342=8, srv1880862544=45, srv195466895=50, srv255085044=66, srv1632138160=30, srv1795676898=37, srv1713207029=33, srv1926583246=47, srv1736972434=34, srv700390273=89, srv1862385149=44, srv1165254812=11, srv1330524900=18, srv615245276=85, srv46717276=76, srv285828138=67, srv1423029200=22, srv2008939655=52, srv1545056905=27, srv108089440=5, srv1050578057=3, srv758563650=90, srv1403508453=20, srv2078671977=57, srv533013140=81, srv1300615743=16, srv450541506=75, srv372818832=69, srv1013312381=1, srv67124375=88, srv149597360=25, srv1771016454=35, srv208936447=59, srv1862243228=43, srv473287282=77, srv1132540374=10, srv1519136017=26, srv1324147104=17, srv1841464037=41, srv393910203=72, srv517528374=80, srv1055871997=4, srv504292405=79, srv1996302706=51, srv225029429=62, srv795511325=94, srv1799215526=38, srv437230654=74, srv873128808=97, srv1576623938=29, srv853995617=96, srv1232062225=14, srv2046392758=54, srv1570523661=28, srv2124163478=60, srv478429764=78, srv1129551783=9, srv1489638681=24, srv215550072=61, srv1253985133=15, srv1362796590=19, srv141649266=21, srv1050112548=2, srv207734984=56, srv577472934=82, srv620781765=86, srv602866656=84, srv1001057129=0, srv774085209=92, srv1196812677=12, srv600324683=83, srv292659911=68, srv373005641=70, srv1952622357=49, srv777334425=93, srv758702680=91, srv1458660072=23, srv1809027764=39, srv1666225102=31, srv1096261795=7, srv1223297050=13, srv1818008930=40, srv249035802=63, srv185671817=42, srv998556676=99, srv2009781797=53, srv1774285694=36, srv956057484=98, srv1901578301=46, srv810024645=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:37,447 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:37,448 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-09 10:53:37,449 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-09 10:53:37,450 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-09 10:53:37,451 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-09 10:53:37,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-09 10:53:37,453 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-09 10:53:37,454 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-09 10:53:37,455 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-09 10:53:37,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022157594012898914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03550501458394378, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022157594012898914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:37,609 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-09 10:53:37,609 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015593748661638979, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022157594012898914); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03550501458394378, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022157594012898914); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01225); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04775, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-09 10:53:37,979 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 508 ms to try 5000 different iterations.  Found a solution that moves 1074 regions; Going from a computed imbalance of 0.015593748661638979 to a new imbalance of 8.885395090802959E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005554433107709862); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009778696008307837); MoveCostFunction : (multiplier=7.0, imbalance=0.11933333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005554433107709862); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:37,982 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv285828138:82 , srv1055871997:83 , srv1666225102:83 , srv1799215526:83 , srv207734984:83 , srv249035802:83 , srv504292405:83 , srv1090858044:84 , srv1232062225:84 , srv1362796590:84 , srv1403508453:84 , srv1423029200:84 , srv1545056905:84 , srv1632138160:84 , srv1771016454:84 , srv1809027764:84 , srv1880862544:84 , srv2008939655:84 , srv2082332851:84 , srv215550072:84 , srv382945566:84 , srv46717276:84 , srv577472934:84 , srv602866656:84 , srv758563650:84 , srv956057484:84 , srv998556676:84 , srv1013312381:85 , srv1050112548:85 , srv1129551783:85 , srv1300615743:85 , srv1330524900:85 , srv1489638681:85 , srv149597360:85 , srv1519136017:85 , srv1677980700:85 , srv1901578301:85 , srv2009781797:85 , srv2046392758:85 , srv225029429:85 , srv40698459:85 , srv450541506:85 , srv517528374:85 , srv533013140:85 , srv615245276:85 , srv620781765:85 , srv655873730:85 , srv67124375:85 , srv873128808:85 , srv1096261795:86 , srv1116127342:86 , srv1223297050:86 , srv141649266:86 , srv1736972434:86 , srv1774285694:86 , srv1795676898:86 , srv1818008930:86 , srv185671817:86 , srv1862243228:86 , srv1862385149:86 , srv1926583246:86 , srv1952622357:86 , srv195466895:86 , srv2068741469:86 , srv2078671977:86 , srv2124163478:86 , srv25202102:86 , srv292659911:86 , srv372818832:86 , srv393910203:86 , srv437230654:86 , srv473287282:86 , srv600324683:86 , srv777334425:86 , srv853995617:86 , srv1001057129:87 , srv1050578057:87 , srv108089440:87 , srv1165254812:87 , srv1196812677:87 , srv1253985133:87 , srv1324147104:87 , srv1576623938:87 , srv1841464037:87 , srv1996302706:87 , srv252254697:87 , srv478429764:87 , srv700390273:87 , srv758702680:87 , srv774085209:87 , srv1132540374:88 , srv1458660072:88 , srv1570523661:88 , srv1944964727:88 , srv208936447:88 , srv255085044:88 , srv373005641:88 , srv795511325:88 , srv1713207029:89 , srv810024645:536 }
2023-05-09 10:53:37,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:37,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1944964727=48, srv2068741469=55, srv2082332851=58, srv1090858044=6, srv1677980700=32, srv382945566=71, srv40698459=73, srv252254697=65, srv25202102=64, srv655873730=87, srv1116127342=8, srv1880862544=45, srv195466895=50, srv255085044=66, srv1632138160=30, srv1795676898=37, srv1713207029=33, srv1926583246=47, srv1736972434=34, srv700390273=89, srv1862385149=44, srv1165254812=11, srv1330524900=18, srv615245276=85, srv46717276=76, srv285828138=67, srv1423029200=22, srv2008939655=52, srv1545056905=27, srv108089440=5, srv1050578057=3, srv758563650=90, srv1403508453=20, srv2078671977=57, srv533013140=81, srv1300615743=16, srv450541506=75, srv372818832=69, srv1013312381=1, srv67124375=88, srv149597360=25, srv1771016454=35, srv208936447=59, srv1862243228=43, srv473287282=77, srv1132540374=10, srv1519136017=26, srv1324147104=17, srv1841464037=41, srv393910203=72, srv517528374=80, srv1055871997=4, srv504292405=79, srv1996302706=51, srv225029429=62, srv795511325=94, srv1799215526=38, srv437230654=74, srv873128808=97, srv1576623938=29, srv853995617=96, srv1232062225=14, srv2046392758=54, srv1570523661=28, srv2124163478=60, srv478429764=78, srv1129551783=9, srv1489638681=24, srv215550072=61, srv1253985133=15, srv1362796590=19, srv141649266=21, srv1050112548=2, srv207734984=56, srv577472934=82, srv620781765=86, srv602866656=84, srv1001057129=0, srv774085209=92, srv1196812677=12, srv600324683=83, srv292659911=68, srv373005641=70, srv1952622357=49, srv777334425=93, srv758702680=91, srv1458660072=23, srv1809027764=39, srv1666225102=31, srv1096261795=7, srv1223297050=13, srv1818008930=40, srv249035802=63, srv185671817=42, srv998556676=99, srv2009781797=53, srv1774285694=36, srv956057484=98, srv1901578301=46, srv810024645=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:38,011 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:38,012 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:38,013 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:38,014 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-09 10:53:38,015 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-09 10:53:38,016 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-09 10:53:38,017 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-09 10:53:38,018 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-09 10:53:38,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-09 10:53:38,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-09 10:53:38,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-09 10:53:38,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-09 10:53:38,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-09 10:53:38,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-09 10:53:38,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-09 10:53:38,187 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005554433107709862); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009778696008307837); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005554433107709862); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:38,187 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-09 10:53:38,188 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.810192003455144E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005554433107709862); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009778696008307837); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005554433107709862); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.833333333333334E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0031666666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-09 10:53:38,571 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 530 ms to try 5000 different iterations.  Found a solution that moves 228 regions; Going from a computed imbalance of 8.810192003455144E-4 to a new imbalance of 1.1990340607516892E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.025333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:38,572 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1576623938:83 , srv1774285694:83 , srv1944964727:83 , srv1952622357:83 , srv473287282:83 , srv1001057129:84 , srv1013312381:84 , srv1050112548:84 , srv1050578057:84 , srv1090858044:84 , srv1129551783:84 , srv1132540374:84 , srv1165254812:84 , srv1232062225:84 , srv1324147104:84 , srv1330524900:84 , srv1362796590:84 , srv141649266:84 , srv1458660072:84 , srv149597360:84 , srv1519136017:84 , srv1570523661:84 , srv1713207029:84 , srv1736972434:84 , srv1809027764:84 , srv1818008930:84 , srv1841464037:84 , srv1880862544:84 , srv195466895:84 , srv1996302706:84 , srv2008939655:84 , srv2009781797:84 , srv2068741469:84 , srv2082332851:84 , srv208936447:84 , srv2124163478:84 , srv225029429:84 , srv252254697:84 , srv255085044:84 , srv373005641:84 , srv393910203:84 , srv478429764:84 , srv533013140:84 , srv577472934:84 , srv600324683:84 , srv620781765:84 , srv67124375:84 , srv777334425:84 , srv795511325:84 , srv873128808:84 , srv998556676:84 , srv108089440:85 , srv1096261795:85 , srv1116127342:85 , srv1196812677:85 , srv1223297050:85 , srv1253985133:85 , srv1300615743:85 , srv1423029200:85 , srv1489638681:85 , srv1545056905:85 , srv1666225102:85 , srv1677980700:85 , srv1771016454:85 , srv1795676898:85 , srv1799215526:85 , srv185671817:85 , srv1862243228:85 , srv1862385149:85 , srv1901578301:85 , srv1926583246:85 , srv2046392758:85 , srv207734984:85 , srv2078671977:85 , srv249035802:85 , srv25202102:85 , srv285828138:85 , srv372818832:85 , srv382945566:85 , srv437230654:85 , srv450541506:85 , srv46717276:85 , srv504292405:85 , srv517528374:85 , srv602866656:85 , srv615245276:85 , srv655873730:85 , srv700390273:85 , srv758563650:85 , srv758702680:85 , srv774085209:85 , srv853995617:85 , srv956057484:85 , srv1055871997:86 , srv1403508453:86 , srv1632138160:86 , srv215550072:86 , srv292659911:86 , srv40698459:86 , srv810024645:635 }
2023-05-09 10:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:38,576 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1944964727=48, srv2068741469=55, srv2082332851=58, srv1090858044=6, srv1677980700=32, srv382945566=71, srv40698459=73, srv252254697=65, srv25202102=64, srv655873730=87, srv1116127342=8, srv1880862544=45, srv195466895=50, srv255085044=66, srv1632138160=30, srv1795676898=37, srv1713207029=33, srv1926583246=47, srv1736972434=34, srv700390273=89, srv1862385149=44, srv1165254812=11, srv1330524900=18, srv615245276=85, srv46717276=76, srv285828138=67, srv1423029200=22, srv2008939655=52, srv1545056905=27, srv108089440=5, srv1050578057=3, srv758563650=90, srv1403508453=20, srv2078671977=57, srv533013140=81, srv1300615743=16, srv450541506=75, srv372818832=69, srv1013312381=1, srv67124375=88, srv149597360=25, srv1771016454=35, srv208936447=59, srv1862243228=43, srv473287282=77, srv1132540374=10, srv1519136017=26, srv1324147104=17, srv1841464037=41, srv393910203=72, srv517528374=80, srv1055871997=4, srv504292405=79, srv1996302706=51, srv225029429=62, srv795511325=94, srv1799215526=38, srv437230654=74, srv873128808=97, srv1576623938=29, srv853995617=96, srv1232062225=14, srv2046392758=54, srv1570523661=28, srv2124163478=60, srv478429764=78, srv1129551783=9, srv1489638681=24, srv215550072=61, srv1253985133=15, srv1362796590=19, srv141649266=21, srv1050112548=2, srv207734984=56, srv577472934=82, srv620781765=86, srv602866656=84, srv1001057129=0, srv774085209=92, srv1196812677=12, srv600324683=83, srv292659911=68, srv373005641=70, srv1952622357=49, srv777334425=93, srv758702680=91, srv1458660072=23, srv1809027764=39, srv1666225102=31, srv1096261795=7, srv1223297050=13, srv1818008930=40, srv249035802=63, srv185671817=42, srv998556676=99, srv2009781797=53, srv1774285694=36, srv956057484=98, srv1901578301=46, srv810024645=95} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:38,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:38,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-09 10:53:38,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-09 10:53:38,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-09 10:53:38,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-09 10:53:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-09 10:53:38,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-09 10:53:38,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-09 10:53:38,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-09 10:53:38,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-09 10:53:38,704 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.0393850485049294E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:38,704 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1576623938:83 , srv1774285694:83 , srv1944964727:83 , srv1952622357:83 , srv473287282:83 , srv1001057129:84 , srv1013312381:84 , srv1050112548:84 , srv1050578057:84 , srv1090858044:84 , srv1129551783:84 , srv1132540374:84 , srv1165254812:84 , srv1232062225:84 , srv1324147104:84 , srv1330524900:84 , srv1362796590:84 , srv141649266:84 , srv1458660072:84 , srv149597360:84 , srv1519136017:84 , srv1570523661:84 , srv1713207029:84 , srv1736972434:84 , srv1809027764:84 , srv1818008930:84 , srv1841464037:84 , srv1880862544:84 , srv195466895:84 , srv1996302706:84 , srv2008939655:84 , srv2009781797:84 , srv2068741469:84 , srv2082332851:84 , srv208936447:84 , srv2124163478:84 , srv225029429:84 , srv252254697:84 , srv255085044:84 , srv373005641:84 , srv393910203:84 , srv478429764:84 , srv533013140:84 , srv577472934:84 , srv600324683:84 , srv620781765:84 , srv67124375:84 , srv777334425:84 , srv795511325:84 , srv873128808:84 , srv998556676:84 , srv108089440:85 , srv1096261795:85 , srv1116127342:85 , srv1196812677:85 , srv1223297050:85 , srv1253985133:85 , srv1300615743:85 , srv1423029200:85 , srv1489638681:85 , srv1545056905:85 , srv1666225102:85 , srv1677980700:85 , srv1771016454:85 , srv1795676898:85 , srv1799215526:85 , srv185671817:85 , srv1862243228:85 , srv1862385149:85 , srv1901578301:85 , srv1926583246:85 , srv2046392758:85 , srv207734984:85 , srv2078671977:85 , srv249035802:85 , srv25202102:85 , srv285828138:85 , srv372818832:85 , srv382945566:85 , srv437230654:85 , srv450541506:85 , srv46717276:85 , srv504292405:85 , srv517528374:85 , srv602866656:85 , srv615245276:85 , srv655873730:85 , srv700390273:85 , srv758563650:85 , srv758702680:85 , srv774085209:85 , srv853995617:85 , srv956057484:85 , srv1055871997:86 , srv1403508453:86 , srv1632138160:86 , srv215550072:86 , srv292659911:86 , srv40698459:86 , srv810024645:635 }
2023-05-09 10:53:38,740 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=372 (was 353) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=13410 (was 14095)
2023-05-09 10:53:38,747 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=372, ProcessCount=175, AvailableMemoryMB=13410
2023-05-09 10:53:38,748 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-09 10:53:38,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-09 10:53:38,760 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000058978:84 , srv1160551998:84 , srv1440149997:84 , srv1444565091:84 , srv1505535613:84 , srv1528644253:84 , srv1578849636:84 , srv1625037635:84 , srv1633129383:84 , srv16708408:84 , srv1780720944:84 , srv1858004191:84 , srv1868166642:84 , srv2049381517:84 , srv235306851:84 , srv248422319:84 , srv262729691:84 , srv459115717:84 , srv527110318:84 , srv529418588:84 , srv53226609:84 , srv548293014:84 , srv551132468:84 , srv650216642:84 , srv761520099:84 , srv769594029:84 , srv791766901:84 , srv837379575:84 , srv994291488:84 , srv1627013373:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-09 10:53:38,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:53:38,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv16708408=10, srv459115717=18, srv994291488=29, srv248422319=16, srv791766901=27, srv837379575=28, srv761520099=25, srv1505535613=4, srv1578849636=6, srv1627013373=8, srv1160551998=1, srv1858004191=12, srv235306851=15, srv1633129383=9, srv650216642=24, srv1440149997=2, srv1000058978=0, srv2049381517=14, srv769594029=26, srv262729691=17, srv527110318=19, srv529418588=20, srv1444565091=3, srv1528644253=5, srv1625037635=7, srv1868166642=13, srv548293014=22, srv1780720944=11, srv53226609=21, srv551132468=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:53:38,777 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:53:38,778 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:53:38,779 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-09 10:53:38,801 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.129453138220139, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:53:38,802 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912600945875777, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.129453138220139, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-09 10:55:38,783 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6258796 different iterations.  Found a solution that moves 1861 regions; Going from a computed imbalance of 0.9912600945875777 to a new imbalance of 4.3436668390529226E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6892592592592592, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:55:38,789 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1000058978:90 , srv1160551998:90 , srv1440149997:90 , srv1444565091:90 , srv1505535613:90 , srv1528644253:90 , srv1578849636:90 , srv1625037635:90 , srv1627013373:90 , srv1633129383:90 , srv16708408:90 , srv1780720944:90 , srv1858004191:90 , srv1868166642:90 , srv2049381517:90 , srv235306851:90 , srv248422319:90 , srv262729691:90 , srv459115717:90 , srv527110318:90 , srv529418588:90 , srv53226609:90 , srv548293014:90 , srv551132468:90 , srv650216642:90 , srv761520099:90 , srv769594029:90 , srv791766901:90 , srv837379575:90 , srv994291488:90 }
2023-05-09 10:55:38,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-09 10:55:38,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv16708408=10, srv459115717=18, srv994291488=29, srv248422319=16, srv791766901=27, srv837379575=28, srv761520099=25, srv1505535613=4, srv1578849636=6, srv1627013373=8, srv1160551998=1, srv1858004191=12, srv235306851=15, srv1633129383=9, srv650216642=24, srv1440149997=2, srv1000058978=0, srv2049381517=14, srv769594029=26, srv262729691=17, srv527110318=19, srv529418588=20, srv1444565091=3, srv1528644253=5, srv1625037635=7, srv1868166642=13, srv548293014=22, srv1780720944=11, srv53226609=21, srv551132468=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-09 10:55:38,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-09 10:55:38,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-09 10:55:38,811 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-09 10:55:38,811 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1000058978:90 , srv1160551998:90 , srv1440149997:90 , srv1444565091:90 , srv1505535613:90 , srv1528644253:90 , srv1578849636:90 , srv1625037635:90 , srv1627013373:90 , srv1633129383:90 , srv16708408:90 , srv1780720944:90 , srv1858004191:90 , srv1868166642:90 , srv2049381517:90 , srv235306851:90 , srv248422319:90 , srv262729691:90 , srv459115717:90 , srv527110318:90 , srv529418588:90 , srv53226609:90 , srv548293014:90 , srv551132468:90 , srv650216642:90 , srv761520099:90 , srv769594029:90 , srv791766901:90 , srv837379575:90 , srv994291488:90 }
2023-05-09 10:55:38,825 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 372), ProcessCount=172 (was 175), AvailableMemoryMB=13431 (was 13410) - AvailableMemoryMB LEAK? -