2023-05-29 00:53:22,734 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-29 00:53:23,007 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-29 00:53:23,105 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-29 00:53:23,162 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-29 00:53:23,170 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-29 00:53:23,182 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=171, AvailableMemoryMB=5147
2023-05-29 00:53:23,184 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-29 00:53:23,184 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-29 00:53:23,319 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1023645925:84 , srv1024988996:84 , srv1028824744:84 , srv1046578966:84 , srv1076046439:84 , srv1117694166:84 , srv1130082435:84 , srv1136369187:84 , srv1136436527:84 , srv1170173561:84 , srv1180171:84 , srv1298795735:84 , srv1345019675:84 , srv1350011529:84 , srv1356411046:84 , srv1362064335:84 , srv1428392372:84 , srv1431285882:84 , srv1432353102:84 , srv1442863619:84 , srv1467421394:84 , srv1473615241:84 , srv147966948:84 , srv1481910537:84 , srv1486504748:84 , srv1486569778:84 , srv1490309326:84 , srv1495454217:84 , srv1528974251:84 , srv1548548894:84 , srv1555776266:84 , srv1556667853:84 , srv1603829089:84 , srv1631766582:84 , srv1646389462:84 , srv164715472:84 , srv1655882043:84 , srv1720407935:84 , srv1777625114:84 , srv1785967806:84 , srv1792834132:84 , srv180535822:84 , srv1817111812:84 , srv18370548:84 , srv1889925805:84 , srv1994367313:84 , srv2011187978:84 , srv2039387286:84 , srv2055276951:84 , srv2061640461:84 , srv208525435:84 , srv209142324:84 , srv2118323473:84 , srv2133254805:84 , srv2140531444:84 , srv231818747:84 , srv238689489:84 , srv244911781:84 , srv255530476:84 , srv276064769:84 , srv285002738:84 , srv292612740:84 , srv297794990:84 , srv302269166:84 , srv317895500:84 , srv360088379:84 , srv367054725:84 , srv385481226:84 , srv404075799:84 , srv414858819:84 , srv429164398:84 , srv435378135:84 , srv451988583:84 , srv483422407:84 , srv495571346:84 , srv555168522:84 , srv564449122:84 , srv584253746:84 , srv620930771:84 , srv623632372:84 , srv641466866:84 , srv648787235:84 , srv651047797:84 , srv65723162:84 , srv699298772:84 , srv718770611:84 , srv725838122:84 , srv734912721:84 , srv736263784:84 , srv778198395:84 , srv784256903:84 , srv796363793:84 , srv840509935:84 , srv84274343:84 , srv87335702:84 , srv875633620:84 , srv931563917:84 , srv952539347:84 , srv956804751:84 , srv885966968:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-29 00:53:23,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:23,333 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:23,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:23,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:23,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:23,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:23,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:23,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:23,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:23,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:23,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:23,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:23,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:23,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:23,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:23,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:23,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:23,412 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:23,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:23,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:23,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:23,700 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:23,701 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-29 00:53:23,701 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-29 00:53:24,349 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 916 ms to try 5000 different iterations.  Found a solution that moves 4715 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17382474801804806. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038600340446411543, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05555959581268286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5238888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038600340446411543, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16916666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23391666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:24,364 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv209142324:82 , srv276064769:82 , srv302269166:82 , srv84274343:82 , srv1180171:83 , srv1556667853:83 , srv2039387286:83 , srv2061640461:83 , srv208525435:83 , srv244911781:83 , srv255530476:83 , srv297794990:83 , srv620930771:83 , srv699298772:83 , srv1481910537:84 , srv2011187978:84 , srv385481226:84 , srv414858819:84 , srv564449122:84 , srv718770611:84 , srv778198395:84 , srv840509935:84 , srv87335702:84 , srv1298795735:85 , srv1495454217:85 , srv1555776266:85 , srv180535822:85 , srv2055276951:85 , srv2140531444:85 , srv231818747:85 , srv360088379:85 , srv584253746:85 , srv651047797:85 , srv65723162:85 , srv952539347:85 , srv1023645925:86 , srv1028824744:86 , srv1117694166:86 , srv1136369187:86 , srv1170173561:86 , srv1428392372:86 , srv1486504748:86 , srv1631766582:86 , srv1646389462:86 , srv1720407935:86 , srv1817111812:86 , srv1994367313:86 , srv404075799:86 , srv483422407:86 , srv555168522:86 , srv641466866:86 , srv784256903:86 , srv1136436527:87 , srv1356411046:87 , srv1431285882:87 , srv1432353102:87 , srv1473615241:87 , srv1603829089:87 , srv164715472:87 , srv18370548:87 , srv2133254805:87 , srv317895500:87 , srv495571346:87 , srv734912721:87 , srv875633620:87 , srv1076046439:88 , srv1345019675:88 , srv1350011529:88 , srv1442863619:88 , srv1467421394:88 , srv1528974251:88 , srv1655882043:88 , srv1785967806:88 , srv1889925805:88 , srv736263784:88 , srv796363793:88 , srv1024988996:89 , srv1490309326:89 , srv1548548894:89 , srv285002738:89 , srv367054725:89 , srv429164398:89 , srv725838122:89 , srv956804751:89 , srv1130082435:90 , srv1362064335:90 , srv147966948:90 , srv1486569778:90 , srv2118323473:90 , srv435378135:90 , srv451988583:90 , srv623632372:90 , srv648787235:90 , srv1046578966:91 , srv238689489:91 , srv292612740:91 , srv931563917:91 , srv1777625114:93 , srv1792834132:93 , srv885966968:433 }
2023-05-29 00:53:24,371 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:24,373 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:24,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:24,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:24,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:24,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:24,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:24,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:24,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:24,402 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:24,403 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:24,404 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:24,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:24,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:24,405 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:24,406 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:24,407 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:24,408 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:24,409 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:24,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:24,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:24,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:24,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:24,410 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:24,619 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038600340446411543, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05555959581268286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038600340446411543, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16916666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23391666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:24,620 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-29 00:53:24,620 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1737917328824014, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.038600340446411543, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05555959581268286, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.038600340446411543, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16916666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23391666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-29 00:53:24,952 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 516 ms to try 5000 different iterations.  Found a solution that moves 2674 regions; Going from a computed imbalance of 0.1737917328824014 to a new imbalance of 0.013004425931482023. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021036254549871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033983557125206225, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2971111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021036254549871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:24,962 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1777625114:79 , srv1046578966:80 , srv238689489:80 , srv648787235:80 , srv1024988996:81 , srv1486569778:81 , srv285002738:81 , srv292612740:81 , srv429164398:81 , srv451988583:81 , srv623632372:81 , srv1130082435:82 , srv1548548894:82 , srv1792834132:82 , srv2118323473:82 , srv367054725:82 , srv435378135:82 , srv931563917:82 , srv1345019675:83 , srv1362064335:83 , srv1442863619:83 , srv1490309326:83 , srv1785967806:83 , srv725838122:83 , srv1076046439:84 , srv1136436527:84 , srv1356411046:84 , srv1467421394:84 , srv147966948:84 , srv1486504748:84 , srv1528974251:84 , srv164715472:84 , srv1889925805:84 , srv2133254805:84 , srv495571346:84 , srv736263784:84 , srv956804751:84 , srv1350011529:85 , srv1431285882:85 , srv1631766582:85 , srv1655882043:85 , srv18370548:85 , srv317895500:85 , srv404075799:85 , srv734912721:85 , srv1023645925:86 , srv1117694166:86 , srv1170173561:86 , srv1432353102:86 , srv1473615241:86 , srv1555776266:86 , srv1603829089:86 , srv1646389462:86 , srv1994367313:86 , srv2140531444:86 , srv555168522:86 , srv840509935:86 , srv87335702:86 , srv875633620:86 , srv952539347:86 , srv1136369187:87 , srv1298795735:87 , srv1428392372:87 , srv1481910537:87 , srv1720407935:87 , srv1817111812:87 , srv2055276951:87 , srv297794990:87 , srv385481226:87 , srv483422407:87 , srv584253746:87 , srv796363793:87 , srv180535822:88 , srv2011187978:88 , srv2061640461:88 , srv208525435:88 , srv276064769:88 , srv360088379:88 , srv414858819:88 , srv651047797:88 , srv65723162:88 , srv699298772:88 , srv784256903:88 , srv1028824744:89 , srv1180171:89 , srv1495454217:89 , srv1556667853:89 , srv244911781:89 , srv564449122:89 , srv641466866:89 , srv231818747:90 , srv620930771:90 , srv718770611:90 , srv778198395:90 , srv209142324:91 , srv255530476:91 , srv84274343:91 , srv2039387286:92 , srv302269166:92 , srv885966968:528 }
2023-05-29 00:53:24,966 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:24,967 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:24,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:24,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:24,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:24,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:24,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:24,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:25,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:25,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:25,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:25,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:25,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:25,160 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021036254549871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033983557125206225, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021036254549871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:25,160 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-29 00:53:25,161 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.012985702183291327, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021036254549871); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.033983557125206225, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021036254549871); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.009916666666666667); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-29 00:53:25,406 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 950 regions; Going from a computed imbalance of 0.012985702183291327 to a new imbalance of 6.522392973277619E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006203515249160302); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008448696430838983); MoveCostFunction : (multiplier=7.0, imbalance=0.10555555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006203515249160302); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:25,408 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1028824744:82 , srv1792834132:82 , srv2039387286:82 , srv231818747:82 , srv641466866:82 , srv796363793:82 , srv255530476:83 , srv718770611:83 , srv778198395:83 , srv784256903:83 , srv1136369187:84 , srv1350011529:84 , srv1428392372:84 , srv1473615241:84 , srv1495454217:84 , srv180535822:84 , srv302269166:84 , srv483422407:84 , srv564449122:84 , srv620930771:84 , srv651047797:84 , srv84274343:84 , srv875633620:84 , srv931563917:84 , srv1023645925:85 , srv1117694166:85 , srv1130082435:85 , srv1170173561:85 , srv1362064335:85 , srv1431285882:85 , srv1432353102:85 , srv147966948:85 , srv1490309326:85 , srv1556667853:85 , srv1603829089:85 , srv1646389462:85 , srv1720407935:85 , srv1777625114:85 , srv1817111812:85 , srv1994367313:85 , srv2011187978:85 , srv2055276951:85 , srv209142324:85 , srv317895500:85 , srv360088379:85 , srv435378135:85 , srv555168522:85 , srv584253746:85 , srv65723162:85 , srv725838122:85 , srv734912721:85 , srv736263784:85 , srv956804751:85 , srv1076046439:86 , srv1180171:86 , srv1298795735:86 , srv1356411046:86 , srv1467421394:86 , srv1481910537:86 , srv1528974251:86 , srv1555776266:86 , srv1631766582:86 , srv1655882043:86 , srv1785967806:86 , srv18370548:86 , srv1889925805:86 , srv208525435:86 , srv2118323473:86 , srv238689489:86 , srv244911781:86 , srv292612740:86 , srv385481226:86 , srv404075799:86 , srv414858819:86 , srv495571346:86 , srv623632372:86 , srv1024988996:87 , srv1136436527:87 , srv1345019675:87 , srv1442863619:87 , srv1486504748:87 , srv1486569778:87 , srv1548548894:87 , srv164715472:87 , srv2061640461:87 , srv2133254805:87 , srv2140531444:87 , srv276064769:87 , srv367054725:87 , srv451988583:87 , srv648787235:87 , srv699298772:87 , srv840509935:87 , srv87335702:87 , srv952539347:87 , srv1046578966:88 , srv285002738:88 , srv297794990:88 , srv429164398:88 , srv885966968:552 }
2023-05-29 00:53:25,411 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:25,413 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:25,426 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:25,427 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:25,428 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:25,429 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:25,430 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:25,431 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:25,432 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:25,433 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:25,434 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:25,435 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:25,436 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:25,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:25,437 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:25,566 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006203515249160302); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008448696430838983); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006203515249160302); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:25,566 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-29 00:53:25,567 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.455872551508137E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006203515249160302); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008448696430838983); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006203515249160302); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.003916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-29 00:53:25,893 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 443 ms to try 5000 different iterations.  Found a solution that moves 264 regions; Going from a computed imbalance of 6.455872551508137E-4 to a new imbalance of 2.6905120302827403E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.029333333333333333, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:25,895 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1046578966:83 , srv1345019675:83 , srv147966948:83 , srv1495454217:83 , srv1603829089:83 , srv1655882043:83 , srv1076046439:84 , srv1136436527:84 , srv1180171:84 , srv1298795735:84 , srv1362064335:84 , srv1432353102:84 , srv1442863619:84 , srv1467421394:84 , srv1486569778:84 , srv1528974251:84 , srv1548548894:84 , srv164715472:84 , srv1817111812:84 , srv18370548:84 , srv1889925805:84 , srv2061640461:84 , srv209142324:84 , srv2118323473:84 , srv2133254805:84 , srv2140531444:84 , srv244911781:84 , srv285002738:84 , srv297794990:84 , srv302269166:84 , srv360088379:84 , srv367054725:84 , srv414858819:84 , srv429164398:84 , srv451988583:84 , srv65723162:84 , srv699298772:84 , srv84274343:84 , srv952539347:84 , srv1023645925:85 , srv1024988996:85 , srv1028824744:85 , srv1117694166:85 , srv1130082435:85 , srv1136369187:85 , srv1170173561:85 , srv1350011529:85 , srv1356411046:85 , srv1428392372:85 , srv1431285882:85 , srv1473615241:85 , srv1481910537:85 , srv1486504748:85 , srv1490309326:85 , srv1555776266:85 , srv1556667853:85 , srv1631766582:85 , srv1646389462:85 , srv1720407935:85 , srv1777625114:85 , srv1785967806:85 , srv1792834132:85 , srv180535822:85 , srv1994367313:85 , srv2011187978:85 , srv2039387286:85 , srv2055276951:85 , srv208525435:85 , srv231818747:85 , srv238689489:85 , srv255530476:85 , srv276064769:85 , srv292612740:85 , srv317895500:85 , srv385481226:85 , srv404075799:85 , srv435378135:85 , srv483422407:85 , srv495571346:85 , srv555168522:85 , srv564449122:85 , srv584253746:85 , srv620930771:85 , srv623632372:85 , srv641466866:85 , srv648787235:85 , srv651047797:85 , srv718770611:85 , srv725838122:85 , srv734912721:85 , srv736263784:85 , srv778198395:85 , srv784256903:85 , srv796363793:85 , srv840509935:85 , srv875633620:85 , srv931563917:85 , srv956804751:85 , srv87335702:86 , srv885966968:629 }
2023-05-29 00:53:25,901 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:25,902 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:25,916 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:25,917 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:25,918 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:25,919 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:25,920 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:25,921 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:26,021 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:26,021 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-29 00:53:26,021 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.505655279260177E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.158529131194229E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.158529131194229E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-29 00:53:26,258 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 330 ms to try 5000 different iterations.  Found a solution that moves 22 regions; Going from a computed imbalance of 2.505655279260177E-5 to a new imbalance of 7.2272865888482504E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0024444444444444444); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:26,259 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1720407935:83 , srv292612740:83 , srv87335702:83 , srv956804751:83 , srv1023645925:84 , srv1024988996:84 , srv1028824744:84 , srv1046578966:84 , srv1076046439:84 , srv1117694166:84 , srv1130082435:84 , srv1136369187:84 , srv1136436527:84 , srv1170173561:84 , srv1180171:84 , srv1298795735:84 , srv1350011529:84 , srv1356411046:84 , srv1362064335:84 , srv1428392372:84 , srv1431285882:84 , srv1432353102:84 , srv1442863619:84 , srv1467421394:84 , srv1473615241:84 , srv147966948:84 , srv1481910537:84 , srv1486504748:84 , srv1486569778:84 , srv1490309326:84 , srv1528974251:84 , srv1548548894:84 , srv1555776266:84 , srv1556667853:84 , srv1631766582:84 , srv1646389462:84 , srv164715472:84 , srv1655882043:84 , srv1777625114:84 , srv1785967806:84 , srv1792834132:84 , srv180535822:84 , srv1817111812:84 , srv18370548:84 , srv1889925805:84 , srv1994367313:84 , srv2011187978:84 , srv2039387286:84 , srv2055276951:84 , srv2061640461:84 , srv208525435:84 , srv209142324:84 , srv2118323473:84 , srv2133254805:84 , srv2140531444:84 , srv231818747:84 , srv238689489:84 , srv244911781:84 , srv255530476:84 , srv276064769:84 , srv285002738:84 , srv297794990:84 , srv302269166:84 , srv317895500:84 , srv360088379:84 , srv367054725:84 , srv385481226:84 , srv404075799:84 , srv414858819:84 , srv429164398:84 , srv435378135:84 , srv451988583:84 , srv483422407:84 , srv495571346:84 , srv555168522:84 , srv564449122:84 , srv584253746:84 , srv620930771:84 , srv623632372:84 , srv641466866:84 , srv648787235:84 , srv651047797:84 , srv65723162:84 , srv699298772:84 , srv718770611:84 , srv725838122:84 , srv734912721:84 , srv736263784:84 , srv778198395:84 , srv784256903:84 , srv796363793:84 , srv840509935:84 , srv875633620:84 , srv931563917:84 , srv952539347:84 , srv1345019675:85 , srv1495454217:85 , srv1603829089:85 , srv84274343:85 , srv885966968:684 }
2023-05-29 00:53:26,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:26,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1548548894=29, srv483422407=73, srv931563917=97, srv778198395=89, srv302269166=63, srv2118323473=52, srv1603829089=32, srv952539347=98, srv231818747=55, srv875633620=95, srv18370548=43, srv796363793=91, srv620930771=78, srv1136436527=8, srv1631766582=33, srv1889925805=44, srv718770611=85, srv1350011529=13, srv2055276951=48, srv1556667853=31, srv244911781=57, srv208525435=50, srv1646389462=34, srv495571346=74, srv1777625114=38, srv1023645925=0, srv1117694166=5, srv255530476=58, srv2061640461=49, srv1028824744=2, srv1046578966=3, srv2140531444=54, srv1481910537=23, srv1136369187=7, srv435378135=71, srv784256903=90, srv623632372=79, srv956804751=99, srv1486504748=24, srv164715472=35, srv414858819=69, srv1467421394=20, srv1495454217=27, srv1792834132=40, srv1345019675=12, srv885966968=96, srv297794990=62, srv404075799=68, srv276064769=59, srv84274343=93, srv1130082435=6, srv1490309326=26, srv1076046439=4, srv1555776266=30, srv1442863619=19, srv180535822=41, srv1432353102=18, srv1528974251=28, srv648787235=81, srv1428392372=16, srv564449122=76, srv360088379=65, srv451988583=72, srv87335702=94, srv1431285882=17, srv1720407935=37, srv317895500=64, srv209142324=51, srv147966948=22, srv367054725=66, srv285002738=60, srv65723162=83, srv1994367313=45, srv238689489=56, srv840509935=92, srv1785967806=39, srv2039387286=47, srv1362064335=15, srv1180171=10, srv2133254805=53, srv651047797=82, srv555168522=75, srv699298772=84, srv584253746=77, srv725838122=86, srv1817111812=42, srv1473615241=21, srv1486569778=25, srv292612740=61, srv1655882043=36, srv1356411046=14, srv1170173561=9, srv1024988996=1, srv736263784=88, srv641466866=80, srv429164398=70, srv385481226=67, srv1298795735=11, srv2011187978=46, srv734912721=87} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:26,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:26,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-29 00:53:26,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-29 00:53:26,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-29 00:53:26,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-29 00:53:26,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-29 00:53:26,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-29 00:53:26,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-29 00:53:26,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-29 00:53:26,403 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:26,403 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1720407935:83 , srv292612740:83 , srv87335702:83 , srv956804751:83 , srv1023645925:84 , srv1024988996:84 , srv1028824744:84 , srv1046578966:84 , srv1076046439:84 , srv1117694166:84 , srv1130082435:84 , srv1136369187:84 , srv1136436527:84 , srv1170173561:84 , srv1180171:84 , srv1298795735:84 , srv1350011529:84 , srv1356411046:84 , srv1362064335:84 , srv1428392372:84 , srv1431285882:84 , srv1432353102:84 , srv1442863619:84 , srv1467421394:84 , srv1473615241:84 , srv147966948:84 , srv1481910537:84 , srv1486504748:84 , srv1486569778:84 , srv1490309326:84 , srv1528974251:84 , srv1548548894:84 , srv1555776266:84 , srv1556667853:84 , srv1631766582:84 , srv1646389462:84 , srv164715472:84 , srv1655882043:84 , srv1777625114:84 , srv1785967806:84 , srv1792834132:84 , srv180535822:84 , srv1817111812:84 , srv18370548:84 , srv1889925805:84 , srv1994367313:84 , srv2011187978:84 , srv2039387286:84 , srv2055276951:84 , srv2061640461:84 , srv208525435:84 , srv209142324:84 , srv2118323473:84 , srv2133254805:84 , srv2140531444:84 , srv231818747:84 , srv238689489:84 , srv244911781:84 , srv255530476:84 , srv276064769:84 , srv285002738:84 , srv297794990:84 , srv302269166:84 , srv317895500:84 , srv360088379:84 , srv367054725:84 , srv385481226:84 , srv404075799:84 , srv414858819:84 , srv429164398:84 , srv435378135:84 , srv451988583:84 , srv483422407:84 , srv495571346:84 , srv555168522:84 , srv564449122:84 , srv584253746:84 , srv620930771:84 , srv623632372:84 , srv641466866:84 , srv648787235:84 , srv651047797:84 , srv65723162:84 , srv699298772:84 , srv718770611:84 , srv725838122:84 , srv734912721:84 , srv736263784:84 , srv778198395:84 , srv784256903:84 , srv796363793:84 , srv840509935:84 , srv875633620:84 , srv931563917:84 , srv952539347:84 , srv1345019675:85 , srv1495454217:85 , srv1603829089:85 , srv84274343:85 , srv885966968:684 }
2023-05-29 00:53:26,430 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 288) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=4674 (was 5147)
2023-05-29 00:53:26,438 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=264, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=171, AvailableMemoryMB=4674
2023-05-29 00:53:26,438 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-29 00:53:26,438 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-29 00:53:26,450 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005925435:84 , srv1011015452:84 , srv1058778101:84 , srv110212337:84 , srv115235117:84 , srv118833127:84 , srv1241832598:84 , srv1507968785:84 , srv1652699573:84 , srv1728553764:84 , srv1780376633:84 , srv2100012743:84 , srv2118423202:84 , srv267107084:84 , srv269020478:84 , srv277433484:84 , srv330329630:84 , srv359495735:84 , srv445257774:84 , srv458223951:84 , srv523634135:84 , srv649444599:84 , srv768567068:84 , srv806550369:84 , srv826945038:84 , srv857049985:84 , srv860506745:84 , srv925587379:84 , srv99329446:84 , srv996965728:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-29 00:53:26,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:53:26,452 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv277433484=15, srv996965728=29, srv925587379=27, srv857049985=25, srv458223951=19, srv1728553764=9, srv768567068=22, srv2100012743=11, srv115235117=4, srv1011015452=1, srv99329446=28, srv330329630=16, srv1507968785=7, srv269020478=14, srv649444599=21, srv118833127=5, srv1241832598=6, srv1780376633=10, srv2118423202=12, srv110212337=3, srv860506745=26, srv1652699573=8, srv1058778101=2, srv1005925435=0, srv359495735=17, srv523634135=20, srv826945038=24, srv445257774=18, srv267107084=13, srv806550369=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:53:26,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:53:26,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:53:26,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:53:26,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:53:26,466 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:53:26,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:53:26,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:53:26,467 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-29 00:53:26,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.112318597006119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:53:26,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912546955495907, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.112318597006119, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-29 00:55:26,471 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6419638 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912546955495907 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:55:26,476 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1005925435:90 , srv1011015452:90 , srv1058778101:90 , srv110212337:90 , srv115235117:90 , srv118833127:90 , srv1241832598:90 , srv1507968785:90 , srv1652699573:90 , srv1728553764:90 , srv1780376633:90 , srv2100012743:90 , srv2118423202:90 , srv267107084:90 , srv269020478:90 , srv277433484:90 , srv330329630:90 , srv359495735:90 , srv445257774:90 , srv458223951:90 , srv523634135:90 , srv649444599:90 , srv768567068:90 , srv806550369:90 , srv826945038:90 , srv857049985:90 , srv860506745:90 , srv925587379:90 , srv99329446:90 , srv996965728:90 }
2023-05-29 00:55:26,478 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-29 00:55:26,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv277433484=15, srv996965728=29, srv925587379=27, srv857049985=25, srv458223951=19, srv1728553764=9, srv768567068=22, srv2100012743=11, srv115235117=4, srv1011015452=1, srv99329446=28, srv330329630=16, srv1507968785=7, srv269020478=14, srv649444599=21, srv118833127=5, srv1241832598=6, srv1780376633=10, srv2118423202=12, srv110212337=3, srv860506745=26, srv1652699573=8, srv1058778101=2, srv1005925435=0, srv359495735=17, srv523634135=20, srv826945038=24, srv445257774=18, srv267107084=13, srv806550369=23} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-29 00:55:26,483 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-29 00:55:26,484 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-29 00:55:26,496 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-29 00:55:26,496 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1005925435:90 , srv1011015452:90 , srv1058778101:90 , srv110212337:90 , srv115235117:90 , srv118833127:90 , srv1241832598:90 , srv1507968785:90 , srv1652699573:90 , srv1728553764:90 , srv1780376633:90 , srv2100012743:90 , srv2118423202:90 , srv267107084:90 , srv269020478:90 , srv277433484:90 , srv330329630:90 , srv359495735:90 , srv445257774:90 , srv458223951:90 , srv523634135:90 , srv649444599:90 , srv768567068:90 , srv806550369:90 , srv826945038:90 , srv857049985:90 , srv860506745:90 , srv925587379:90 , srv99329446:90 , srv996965728:90 }
2023-05-29 00:55:26,511 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=264 (was 264), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 297), ProcessCount=168 (was 171), AvailableMemoryMB=4451 (was 4674)