2023-05-10 04:53:32,852 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-10 04:53:33,188 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-10 04:53:33,309 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-10 04:53:33,375 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-10 04:53:33,382 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-10 04:53:33,398 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=173, AvailableMemoryMB=11041
2023-05-10 04:53:33,401 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-10 04:53:33,401 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-10 04:53:33,526 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1005991661:84 , srv1065319415:84 , srv1071744499:84 , srv1088990728:84 , srv1093480259:84 , srv1102749294:84 , srv1119743891:84 , srv112832054:84 , srv114025265:84 , srv1169661113:84 , srv1200765115:84 , srv1221866537:84 , srv1226972974:84 , srv1267470677:84 , srv1272166700:84 , srv1280066460:84 , srv1304936969:84 , srv1307761847:84 , srv134257064:84 , srv1344813793:84 , srv1395285444:84 , srv1438807299:84 , srv1443174493:84 , srv144945660:84 , srv1481521434:84 , srv1487644805:84 , srv1499412067:84 , srv1501756980:84 , srv1510782846:84 , srv1570424574:84 , srv1610520188:84 , srv1614194128:84 , srv1630076061:84 , srv1637356151:84 , srv1639393125:84 , srv1670722220:84 , srv1670801004:84 , srv1680426479:84 , srv1711512581:84 , srv1719429020:84 , srv1750270634:84 , srv1761713567:84 , srv1764621936:84 , srv17928624:84 , srv1794260458:84 , srv1795213860:84 , srv1805997974:84 , srv1820716774:84 , srv1831645174:84 , srv1834260677:84 , srv1860630056:84 , srv188126821:84 , srv192034399:84 , srv1933340008:84 , srv1948037247:84 , srv1996570757:84 , srv2017873829:84 , srv2109883802:84 , srv2112076811:84 , srv2122553261:84 , srv230580653:84 , srv240343291:84 , srv278619597:84 , srv287151575:84 , srv310085582:84 , srv326999586:84 , srv379553122:84 , srv40834358:84 , srv421537473:84 , srv443258485:84 , srv49532504:84 , srv506121447:84 , srv530640197:84 , srv531396533:84 , srv573761715:84 , srv58684014:84 , srv612986075:84 , srv614604149:84 , srv63224852:84 , srv637220308:84 , srv656645151:84 , srv689315853:84 , srv732005212:84 , srv732641125:84 , srv766669876:84 , srv770570786:84 , srv780067479:84 , srv793286731:84 , srv82975849:84 , srv843981469:84 , srv851187982:84 , srv860391071:84 , srv896118618:84 , srv909845823:84 , srv924174193:84 , srv931532193:84 , srv943794241:84 , srv95033915:84 , srv987413780:84 , srv1377724649:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-10 04:53:33,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:33,541 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:33,629 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:33,630 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:33,631 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:33,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:33,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:33,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:33,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:33,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:33,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:33,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:33,829 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:33,830 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-10 04:53:33,830 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-10 04:53:34,227 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 568 ms to try 5000 different iterations.  Found a solution that moves 4699 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17444016518174182. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04197577077714836, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062023492164234945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5221111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04197577077714836, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23858333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:34,240 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv924174193:82 , srv112832054:83 , srv1200765115:83 , srv1395285444:83 , srv1719429020:83 , srv326999586:83 , srv40834358:83 , srv860391071:83 , srv95033915:83 , srv987413780:83 , srv1267470677:84 , srv1280066460:84 , srv1438807299:84 , srv144945660:84 , srv1680426479:84 , srv1794260458:84 , srv1795213860:84 , srv1831645174:84 , srv192034399:84 , srv1933340008:84 , srv2109883802:84 , srv240343291:84 , srv49532504:84 , srv531396533:84 , srv612986075:84 , srv689315853:84 , srv766669876:84 , srv770570786:84 , srv793286731:84 , srv943794241:84 , srv1093480259:85 , srv1102749294:85 , srv1119743891:85 , srv1169661113:85 , srv1570424574:85 , srv1610520188:85 , srv1670801004:85 , srv1761713567:85 , srv1764621936:85 , srv379553122:85 , srv421537473:85 , srv443258485:85 , srv82975849:85 , srv851187982:85 , srv896118618:85 , srv1005991661:86 , srv1221866537:86 , srv1443174493:86 , srv1481521434:86 , srv1670722220:86 , srv17928624:86 , srv188126821:86 , srv2112076811:86 , srv278619597:86 , srv310085582:86 , srv573761715:86 , srv63224852:86 , srv637220308:86 , srv656645151:86 , srv732641125:86 , srv1065319415:87 , srv1088990728:87 , srv1344813793:87 , srv1499412067:87 , srv1501756980:87 , srv1630076061:87 , srv1711512581:87 , srv1820716774:87 , srv1996570757:87 , srv530640197:87 , srv614604149:87 , srv909845823:87 , srv1071744499:88 , srv1307761847:88 , srv134257064:88 , srv1487644805:88 , srv1510782846:88 , srv1637356151:88 , srv1750270634:88 , srv1834260677:88 , srv2017873829:88 , srv2122553261:88 , srv230580653:88 , srv58684014:88 , srv114025265:89 , srv1272166700:89 , srv1614194128:89 , srv1639393125:89 , srv1860630056:89 , srv1948037247:89 , srv506121447:89 , srv732005212:89 , srv780067479:89 , srv843981469:90 , srv931532193:90 , srv1805997974:92 , srv1304936969:93 , srv287151575:98 , srv1226972974:99 , srv1377724649:463 }
2023-05-10 04:53:34,244 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:34,245 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:34,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:34,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:34,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:34,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:34,268 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:34,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:34,270 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:34,271 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:34,272 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:34,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04197577077714836, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062023492164234945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04197577077714836, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23858333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:34,415 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-10 04:53:34,416 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17440726208048973, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04197577077714836, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.062023492164234945, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04197577077714836, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16933333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23858333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-10 04:53:34,743 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 2619 regions; Going from a computed imbalance of 0.17440726208048973 to a new imbalance of 0.015352629435706398. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023276345351007404); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041668350134341406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.291, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023276345351007404); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:34,760 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1226972974:74 , srv287151575:74 , srv1304936969:77 , srv1805997974:80 , srv931532193:80 , srv780067479:81 , srv843981469:81 , srv114025265:82 , srv506121447:82 , srv732005212:82 , srv1272166700:83 , srv1307761847:83 , srv1639393125:83 , srv1948037247:83 , srv2122553261:83 , srv1344813793:84 , srv1499412067:84 , srv1637356151:84 , srv1764621936:84 , srv1996570757:84 , srv230580653:84 , srv278619597:84 , srv909845823:84 , srv1065319415:85 , srv1221866537:85 , srv1443174493:85 , srv1614194128:85 , srv1670722220:85 , srv1711512581:85 , srv1750270634:85 , srv1820716774:85 , srv1860630056:85 , srv2017873829:85 , srv573761715:85 , srv63224852:85 , srv656645151:85 , srv732641125:85 , srv82975849:85 , srv896118618:85 , srv1005991661:86 , srv1088990728:86 , srv1093480259:86 , srv1169661113:86 , srv134257064:86 , srv1487644805:86 , srv1761713567:86 , srv17928624:86 , srv1834260677:86 , srv188126821:86 , srv2112076811:86 , srv310085582:86 , srv49532504:86 , srv530640197:86 , srv614604149:86 , srv851187982:86 , srv1071744499:87 , srv1438807299:87 , srv144945660:87 , srv1481521434:87 , srv1501756980:87 , srv1510782846:87 , srv1610520188:87 , srv1630076061:87 , srv1680426479:87 , srv1795213860:87 , srv1831645174:87 , srv192034399:87 , srv1933340008:87 , srv379553122:87 , srv40834358:87 , srv58684014:87 , srv637220308:87 , srv689315853:87 , srv766669876:87 , srv770570786:87 , srv860391071:87 , srv1102749294:88 , srv1119743891:88 , srv1267470677:88 , srv1280066460:88 , srv1570424574:88 , srv1670801004:88 , srv2109883802:88 , srv240343291:88 , srv326999586:88 , srv443258485:88 , srv531396533:88 , srv612986075:88 , srv793286731:88 , srv943794241:88 , srv987413780:88 , srv112832054:89 , srv1719429020:89 , srv421537473:89 , srv1200765115:90 , srv1395285444:90 , srv924174193:90 , srv1794260458:91 , srv95033915:91 , srv1377724649:518 }
2023-05-10 04:53:34,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:34,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:34,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:34,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:34,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:34,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:34,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:34,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:34,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:34,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:34,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:34,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:34,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:34,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:34,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:34,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:34,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023276345351007404); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041668350134341406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023276345351007404); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:34,965 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-10 04:53:34,965 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015334290805747003, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023276345351007404); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041668350134341406, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023276345351007404); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012166666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04533333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-10 04:53:35,324 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 484 ms to try 5000 different iterations.  Found a solution that moves 979 regions; Going from a computed imbalance of 0.015334290805747003 to a new imbalance of 7.71822361332984E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007560703336463659); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013517250067329378); MoveCostFunction : (multiplier=7.0, imbalance=0.10877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007560703336463659); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:35,326 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv58684014:81 , srv1510782846:82 , srv1071744499:83 , srv1487644805:83 , srv1501756980:83 , srv1630076061:83 , srv1794260458:83 , srv1860630056:83 , srv421537473:83 , srv530640197:83 , srv637220308:83 , srv1088990728:84 , srv1102749294:84 , srv134257064:84 , srv1614194128:84 , srv1670801004:84 , srv1750270634:84 , srv1805997974:84 , srv1834260677:84 , srv443258485:84 , srv612986075:84 , srv614604149:84 , srv793286731:84 , srv95033915:84 , srv1005991661:85 , srv1065319415:85 , srv1119743891:85 , srv112832054:85 , srv1169661113:85 , srv1200765115:85 , srv1226972974:85 , srv1267470677:85 , srv1272166700:85 , srv1280066460:85 , srv1344813793:85 , srv1481521434:85 , srv1570424574:85 , srv1610520188:85 , srv1637356151:85 , srv1639393125:85 , srv1711512581:85 , srv17928624:85 , srv1831645174:85 , srv188126821:85 , srv1948037247:85 , srv2112076811:85 , srv230580653:85 , srv310085582:85 , srv924174193:85 , srv943794241:85 , srv1221866537:86 , srv1307761847:86 , srv1395285444:86 , srv1443174493:86 , srv144945660:86 , srv1670722220:86 , srv1680426479:86 , srv1719429020:86 , srv1795213860:86 , srv1820716774:86 , srv1933340008:86 , srv1996570757:86 , srv2017873829:86 , srv2109883802:86 , srv2122553261:86 , srv240343291:86 , srv287151575:86 , srv506121447:86 , srv531396533:86 , srv573761715:86 , srv63224852:86 , srv656645151:86 , srv732005212:86 , srv766669876:86 , srv851187982:86 , srv987413780:86 , srv1093480259:87 , srv114025265:87 , srv1304936969:87 , srv1438807299:87 , srv1499412067:87 , srv192034399:87 , srv326999586:87 , srv379553122:87 , srv40834358:87 , srv49532504:87 , srv689315853:87 , srv732641125:87 , srv770570786:87 , srv780067479:87 , srv843981469:87 , srv896118618:87 , srv909845823:87 , srv1761713567:88 , srv1764621936:88 , srv278619597:88 , srv82975849:88 , srv860391071:88 , srv931532193:89 , srv1377724649:544 }
2023-05-10 04:53:35,330 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:35,331 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:35,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:35,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:35,349 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:35,350 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:35,351 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:35,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:35,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:35,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:35,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:35,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:35,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:35,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:35,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:35,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007560703336463659); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013517250067329378); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007560703336463659); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:35,472 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-10 04:53:35,472 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=7.649672568158971E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.007560703336463659); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.013517250067329378); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.007560703336463659); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004916666666666666); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-10 04:53:35,853 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 481 ms to try 5000 different iterations.  Found a solution that moves 314 regions; Going from a computed imbalance of 7.649672568158971E-4 to a new imbalance of 2.7744993616493E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.034888888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:35,858 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1395285444:83 , srv1719429020:83 , srv1761713567:83 , srv192034399:83 , srv2017873829:83 , srv860391071:83 , srv931532193:83 , srv1005991661:84 , srv1071744499:84 , srv1093480259:84 , srv1119743891:84 , srv114025265:84 , srv1226972974:84 , srv134257064:84 , srv1438807299:84 , srv144945660:84 , srv1481521434:84 , srv1499412067:84 , srv1501756980:84 , srv1570424574:84 , srv1614194128:84 , srv17928624:84 , srv1794260458:84 , srv1820716774:84 , srv1834260677:84 , srv2109883802:84 , srv278619597:84 , srv287151575:84 , srv326999586:84 , srv379553122:84 , srv506121447:84 , srv689315853:84 , srv732641125:84 , srv770570786:84 , srv82975849:84 , srv843981469:84 , srv909845823:84 , srv1065319415:85 , srv1088990728:85 , srv1102749294:85 , srv112832054:85 , srv1200765115:85 , srv1221866537:85 , srv1267470677:85 , srv1272166700:85 , srv1280066460:85 , srv1304936969:85 , srv1307761847:85 , srv1443174493:85 , srv1487644805:85 , srv1510782846:85 , srv1610520188:85 , srv1630076061:85 , srv1637356151:85 , srv1639393125:85 , srv1670722220:85 , srv1670801004:85 , srv1680426479:85 , srv1711512581:85 , srv1750270634:85 , srv1764621936:85 , srv1795213860:85 , srv1860630056:85 , srv188126821:85 , srv1933340008:85 , srv1948037247:85 , srv1996570757:85 , srv2112076811:85 , srv2122553261:85 , srv230580653:85 , srv240343291:85 , srv310085582:85 , srv40834358:85 , srv421537473:85 , srv443258485:85 , srv49532504:85 , srv531396533:85 , srv573761715:85 , srv58684014:85 , srv614604149:85 , srv656645151:85 , srv732005212:85 , srv766669876:85 , srv780067479:85 , srv896118618:85 , srv924174193:85 , srv943794241:85 , srv95033915:85 , srv1169661113:86 , srv1344813793:86 , srv1831645174:86 , srv530640197:86 , srv612986075:86 , srv63224852:86 , srv637220308:86 , srv793286731:86 , srv851187982:86 , srv987413780:86 , srv1805997974:87 , srv1377724649:617 }
2023-05-10 04:53:35,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:35,862 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:35,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:35,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:35,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:35,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:35,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:35,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:35,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:35,885 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:35,886 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:36,037 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:36,037 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-10 04:53:36,037 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.5546318623270077E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-10 04:53:36,301 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 29 regions; Going from a computed imbalance of 2.5546318623270077E-5 to a new imbalance of 6.235141079866791E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0032222222222222222); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:36,302 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1200765115:83 , srv1805997974:83 , srv240343291:83 , srv379553122:83 , srv531396533:83 , srv63224852:83 , srv851187982:83 , srv95033915:83 , srv987413780:83 , srv1065319415:84 , srv1071744499:84 , srv1088990728:84 , srv1093480259:84 , srv1102749294:84 , srv1119743891:84 , srv112832054:84 , srv114025265:84 , srv1169661113:84 , srv1221866537:84 , srv1226972974:84 , srv1267470677:84 , srv1272166700:84 , srv1280066460:84 , srv1304936969:84 , srv1307761847:84 , srv134257064:84 , srv1344813793:84 , srv1395285444:84 , srv1438807299:84 , srv1443174493:84 , srv1481521434:84 , srv1487644805:84 , srv1499412067:84 , srv1510782846:84 , srv1570424574:84 , srv1610520188:84 , srv1614194128:84 , srv1630076061:84 , srv1637356151:84 , srv1639393125:84 , srv1670722220:84 , srv1670801004:84 , srv1680426479:84 , srv1711512581:84 , srv1750270634:84 , srv1761713567:84 , srv1764621936:84 , srv1794260458:84 , srv1795213860:84 , srv1820716774:84 , srv1831645174:84 , srv1834260677:84 , srv1860630056:84 , srv188126821:84 , srv1933340008:84 , srv1948037247:84 , srv1996570757:84 , srv2017873829:84 , srv2109883802:84 , srv2112076811:84 , srv2122553261:84 , srv230580653:84 , srv278619597:84 , srv287151575:84 , srv310085582:84 , srv326999586:84 , srv40834358:84 , srv421537473:84 , srv443258485:84 , srv49532504:84 , srv530640197:84 , srv573761715:84 , srv612986075:84 , srv614604149:84 , srv637220308:84 , srv656645151:84 , srv689315853:84 , srv732005212:84 , srv732641125:84 , srv766669876:84 , srv770570786:84 , srv780067479:84 , srv793286731:84 , srv82975849:84 , srv843981469:84 , srv896118618:84 , srv909845823:84 , srv924174193:84 , srv931532193:84 , srv943794241:84 , srv1005991661:85 , srv144945660:85 , srv1501756980:85 , srv1719429020:85 , srv17928624:85 , srv192034399:85 , srv506121447:85 , srv58684014:85 , srv860391071:85 , srv1377724649:684 }
2023-05-10 04:53:36,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:36,307 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1831645174=49, srv144945660=24, srv1510782846=29, srv379553122=67, srv1304936969=16, srv780067479=87, srv40834358=68, srv1761713567=42, srv1680426479=38, srv732005212=83, srv1795213860=46, srv531396533=74, srv1711512581=39, srv1071744499=2, srv114025265=8, srv2112076811=59, srv851187982=91, srv287151575=64, srv909845823=94, srv931532193=96, srv95033915=98, srv1750270634=41, srv278619597=63, srv1344813793=19, srv612986075=77, srv1487644805=26, srv112832054=7, srv1794260458=45, srv443258485=70, srv1670722220=36, srv924174193=95, srv192034399=53, srv134257064=18, srv1267470677=13, srv17928624=44, srv1169661113=9, srv1088990728=3, srv1820716774=48, srv637220308=80, srv1670801004=37, srv1860630056=51, srv1200765115=10, srv793286731=88, srv770570786=86, srv82975849=89, srv1610520188=31, srv1280066460=15, srv689315853=82, srv1395285444=21, srv1614194128=32, srv230580653=61, srv732641125=84, srv1719429020=40, srv1630076061=33, srv1377724649=20, srv1481521434=25, srv1637356151=34, srv1764621936=43, srv1639393125=35, srv2122553261=60, srv188126821=52, srv530640197=73, srv860391071=92, srv1948037247=55, srv1102749294=5, srv1226972974=12, srv766669876=85, srv843981469=90, srv1996570757=56, srv1119743891=6, srv1570424574=30, srv1501756980=28, srv49532504=71, srv326999586=66, srv1499412067=27, srv1093480259=4, srv987413780=99, srv1834260677=50, srv506121447=72, srv1221866537=11, srv1307761847=17, srv1933340008=54, srv2017873829=57, srv1805997974=47, srv656645151=81, srv1272166700=14, srv614604149=78, srv63224852=79, srv943794241=97, srv896118618=93, srv310085582=65, srv2109883802=58, srv1438807299=22, srv240343291=62, srv573761715=75, srv1065319415=1, srv58684014=76, srv1443174493=23, srv421537473=69, srv1005991661=0} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:36,320 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:36,321 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:36,322 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-10 04:53:36,323 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-10 04:53:36,324 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-10 04:53:36,325 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-10 04:53:36,326 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-10 04:53:36,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-10 04:53:36,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-10 04:53:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-10 04:53:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-10 04:53:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-10 04:53:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-10 04:53:36,329 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-10 04:53:36,461 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:36,462 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1200765115:83 , srv1805997974:83 , srv240343291:83 , srv379553122:83 , srv531396533:83 , srv63224852:83 , srv851187982:83 , srv95033915:83 , srv987413780:83 , srv1065319415:84 , srv1071744499:84 , srv1088990728:84 , srv1093480259:84 , srv1102749294:84 , srv1119743891:84 , srv112832054:84 , srv114025265:84 , srv1169661113:84 , srv1221866537:84 , srv1226972974:84 , srv1267470677:84 , srv1272166700:84 , srv1280066460:84 , srv1304936969:84 , srv1307761847:84 , srv134257064:84 , srv1344813793:84 , srv1395285444:84 , srv1438807299:84 , srv1443174493:84 , srv1481521434:84 , srv1487644805:84 , srv1499412067:84 , srv1510782846:84 , srv1570424574:84 , srv1610520188:84 , srv1614194128:84 , srv1630076061:84 , srv1637356151:84 , srv1639393125:84 , srv1670722220:84 , srv1670801004:84 , srv1680426479:84 , srv1711512581:84 , srv1750270634:84 , srv1761713567:84 , srv1764621936:84 , srv1794260458:84 , srv1795213860:84 , srv1820716774:84 , srv1831645174:84 , srv1834260677:84 , srv1860630056:84 , srv188126821:84 , srv1933340008:84 , srv1948037247:84 , srv1996570757:84 , srv2017873829:84 , srv2109883802:84 , srv2112076811:84 , srv2122553261:84 , srv230580653:84 , srv278619597:84 , srv287151575:84 , srv310085582:84 , srv326999586:84 , srv40834358:84 , srv421537473:84 , srv443258485:84 , srv49532504:84 , srv530640197:84 , srv573761715:84 , srv612986075:84 , srv614604149:84 , srv637220308:84 , srv656645151:84 , srv689315853:84 , srv732005212:84 , srv732641125:84 , srv766669876:84 , srv770570786:84 , srv780067479:84 , srv793286731:84 , srv82975849:84 , srv843981469:84 , srv896118618:84 , srv909845823:84 , srv924174193:84 , srv931532193:84 , srv943794241:84 , srv1005991661:85 , srv144945660:85 , srv1501756980:85 , srv1719429020:85 , srv17928624:85 , srv192034399:85 , srv506121447:85 , srv58684014:85 , srv860391071:85 , srv1377724649:684 }
2023-05-10 04:53:36,494 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 325) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=10178 (was 11041)
2023-05-10 04:53:36,504 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=175, AvailableMemoryMB=10176
2023-05-10 04:53:36,507 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-10 04:53:36,507 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-10 04:53:36,518 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1013781596:84 , srv1055227240:84 , srv1080223967:84 , srv1158016713:84 , srv1232166512:84 , srv130535476:84 , srv1345382641:84 , srv1448081611:84 , srv1462695605:84 , srv1464119046:84 , srv1465180709:84 , srv1484362516:84 , srv1496036896:84 , srv1626834972:84 , srv1656300556:84 , srv1669854865:84 , srv1799311892:84 , srv1833287774:84 , srv1868416197:84 , srv1920934053:84 , srv321778779:84 , srv358335239:84 , srv505734195:84 , srv531593430:84 , srv596607608:84 , srv612439745:84 , srv735482965:84 , srv838285384:84 , srv929351395:84 , srv1414938544:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-10 04:53:36,519 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:53:36,520 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1799311892=17, srv1496036896=13, srv929351395=29, srv1462695605=9, srv1656300556=15, srv1464119046=10, srv1484362516=12, srv505734195=23, srv838285384=28, srv1013781596=0, srv1465180709=11, srv1626834972=14, srv531593430=24, srv596607608=25, srv1833287774=18, srv130535476=5, srv1158016713=3, srv1080223967=2, srv358335239=22, srv1669854865=16, srv1232166512=4, srv1345382641=6, srv1448081611=8, srv735482965=27, srv1920934053=20, srv1414938544=7, srv321778779=21, srv1055227240=1, srv1868416197=19, srv612439745=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:53:36,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:53:36,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:53:36,532 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:53:36,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:53:36,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:53:36,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:53:36,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:53:36,533 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-10 04:53:36,554 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1511999771352763, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:53:36,554 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912669469455099, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1511999771352763, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-10 04:55:36,536 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6101136 different iterations.  Found a solution that moves 1858 regions; Going from a computed imbalance of 0.9912669469455099 to a new imbalance of 4.336664689392977E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6881481481481482, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:55:36,544 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1013781596:90 , srv1055227240:90 , srv1080223967:90 , srv1158016713:90 , srv1232166512:90 , srv130535476:90 , srv1345382641:90 , srv1414938544:90 , srv1448081611:90 , srv1462695605:90 , srv1464119046:90 , srv1465180709:90 , srv1484362516:90 , srv1496036896:90 , srv1626834972:90 , srv1656300556:90 , srv1669854865:90 , srv1799311892:90 , srv1833287774:90 , srv1868416197:90 , srv1920934053:90 , srv321778779:90 , srv358335239:90 , srv505734195:90 , srv531593430:90 , srv596607608:90 , srv612439745:90 , srv735482965:90 , srv838285384:90 , srv929351395:90 }
2023-05-10 04:55:36,545 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-10 04:55:36,546 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1799311892=17, srv1496036896=13, srv929351395=29, srv1462695605=9, srv1656300556=15, srv1464119046=10, srv1484362516=12, srv505734195=23, srv838285384=28, srv1013781596=0, srv1465180709=11, srv1626834972=14, srv531593430=24, srv596607608=25, srv1833287774=18, srv130535476=5, srv1158016713=3, srv1080223967=2, srv358335239=22, srv1669854865=16, srv1232166512=4, srv1345382641=6, srv1448081611=8, srv735482965=27, srv1920934053=20, srv1414938544=7, srv321778779=21, srv1055227240=1, srv1868416197=19, srv612439745=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-10 04:55:36,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-10 04:55:36,550 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-10 04:55:36,567 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-10 04:55:36,568 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1013781596:90 , srv1055227240:90 , srv1080223967:90 , srv1158016713:90 , srv1232166512:90 , srv130535476:90 , srv1345382641:90 , srv1414938544:90 , srv1448081611:90 , srv1462695605:90 , srv1464119046:90 , srv1465180709:90 , srv1484362516:90 , srv1496036896:90 , srv1626834972:90 , srv1656300556:90 , srv1669854865:90 , srv1799311892:90 , srv1833287774:90 , srv1868416197:90 , srv1920934053:90 , srv321778779:90 , srv358335239:90 , srv505734195:90 , srv531593430:90 , srv596607608:90 , srv612439745:90 , srv735482965:90 , srv838285384:90 , srv929351395:90 }
2023-05-10 04:55:36,586 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 347), ProcessCount=174 (was 175), AvailableMemoryMB=9938 (was 10176)