2024-04-12 07:53:16,047 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2024-04-12 07:53:16,392 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2024-04-12 07:53:16,507 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2024-04-12 07:53:16,571 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-12 07:53:16,578 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-12 07:53:16,593 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=171, AvailableMemoryMB=9174
2024-04-12 07:53:16,595 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-12 07:53:16,595 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2024-04-12 07:53:16,729 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1050565156:84 , srv1072970572:84 , srv1079585059:84 , srv1095795985:84 , srv1107192108:84 , srv1128779572:84 , srv1165609933:84 , srv1171003963:84 , srv1184774767:84 , srv1217888679:84 , srv1225533443:84 , srv1271916103:84 , srv1279174744:84 , srv1289216103:84 , srv1298077863:84 , srv130720582:84 , srv1308248012:84 , srv1320654357:84 , srv1323437967:84 , srv1340569593:84 , srv1347430242:84 , srv1357257721:84 , srv1371411653:84 , srv1393025142:84 , srv1444578611:84 , srv1466670860:84 , srv1510579911:84 , srv1510786178:84 , srv1520745334:84 , srv1523260827:84 , srv1555951312:84 , srv156229896:84 , srv1563234535:84 , srv156751957:84 , srv1580222084:84 , srv15897168:84 , srv1597105844:84 , srv1680524609:84 , srv1686182357:84 , srv1687994565:84 , srv176329502:84 , srv1779728139:84 , srv1872563524:84 , srv187682667:84 , srv1905703303:84 , srv1910886391:84 , srv1942521221:84 , srv1975711878:84 , srv1976621818:84 , srv1978344803:84 , srv1985002020:84 , srv1987027737:84 , srv1992349641:84 , srv1999146511:84 , srv2052126656:84 , srv2056858097:84 , srv2059646680:84 , srv2125508262:84 , srv2139616464:84 , srv218716660:84 , srv245870952:84 , srv252488325:84 , srv259643500:84 , srv260320426:84 , srv273640428:84 , srv319007026:84 , srv323456157:84 , srv344415501:84 , srv347284036:84 , srv347629829:84 , srv41094362:84 , srv44573892:84 , srv465371378:84 , srv492562350:84 , srv525405794:84 , srv573122959:84 , srv651992714:84 , srv661394698:84 , srv739226438:84 , srv745340538:84 , srv748733757:84 , srv761544430:84 , srv772393482:84 , srv779638851:84 , srv79771143:84 , srv815069787:84 , srv833202178:84 , srv834457694:84 , srv841135623:84 , srv846111028:84 , srv870508236:84 , srv898638444:84 , srv909312522:84 , srv913346790:84 , srv928431703:84 , srv94239986:84 , srv959040137:84 , srv971057118:84 , srv992568956:84 , srv631386898:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2024-04-12 07:53:16,739 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:16,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:16,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:16,843 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:16,844 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:16,845 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:16,846 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:16,847 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:16,848 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:16,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:16,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:16,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:16,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:16,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:16,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:16,854 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:16,855 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:16,856 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:16,857 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:16,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:16,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:16,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:16,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:16,858 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:16,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:16,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:17,120 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:17,120 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-12 07:53:17,121 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-12 07:53:17,608 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 717 ms to try 5000 different iterations.  Found a solution that moves 4748 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17144189775969204. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040506827728852626, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05910860479231283, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5275555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040506827728852626, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1665, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:17,629 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1466670860:82 , srv344415501:82 , srv1289216103:83 , srv1371411653:83 , srv1686182357:83 , srv1687994565:83 , srv1872563524:83 , srv187682667:83 , srv1905703303:83 , srv2052126656:83 , srv44573892:83 , srv465371378:83 , srv492562350:83 , srv833202178:83 , srv913346790:83 , srv1171003963:84 , srv1271916103:84 , srv1510579911:84 , srv1680524609:84 , srv1985002020:84 , srv2125508262:84 , srv252488325:84 , srv273640428:84 , srv347284036:84 , srv525405794:84 , srv94239986:84 , srv1072970572:85 , srv1298077863:85 , srv1320654357:85 , srv1523260827:85 , srv1992349641:85 , srv573122959:85 , srv761544430:85 , srv772393482:85 , srv815069787:85 , srv959040137:85 , srv1079585059:86 , srv1107192108:86 , srv1128779572:86 , srv1308248012:86 , srv1323437967:86 , srv1393025142:86 , srv1580222084:86 , srv15897168:86 , srv1910886391:86 , srv2059646680:86 , srv2139616464:86 , srv259643500:86 , srv260320426:86 , srv319007026:86 , srv651992714:86 , srv846111028:86 , srv870508236:86 , srv928431703:86 , srv1050565156:87 , srv1095795985:87 , srv1165609933:87 , srv1217888679:87 , srv1279174744:87 , srv130720582:87 , srv1340569593:87 , srv1357257721:87 , srv1444578611:87 , srv1555951312:87 , srv176329502:87 , srv1779728139:87 , srv1975711878:87 , srv1978344803:87 , srv218716660:87 , srv347629829:87 , srv41094362:87 , srv739226438:87 , srv745340538:87 , srv909312522:87 , srv1184774767:88 , srv1225533443:88 , srv156229896:88 , srv661394698:88 , srv779638851:88 , srv79771143:88 , srv834457694:88 , srv971057118:88 , srv992568956:88 , srv1347430242:89 , srv1597105844:89 , srv1987027737:89 , srv2056858097:89 , srv1520745334:90 , srv1563234535:90 , srv1976621818:90 , srv748733757:90 , srv1510786178:91 , srv156751957:91 , srv1942521221:91 , srv1999146511:91 , srv245870952:92 , srv898638444:92 , srv323456157:93 , srv841135623:96 , srv631386898:450 }
2024-04-12 07:53:17,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:17,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:17,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:17,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:17,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:17,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:17,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:17,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:17,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:17,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:17,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:17,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:17,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:17,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:17,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:17,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:17,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:17,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:17,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:17,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:17,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:17,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:17,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:17,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:17,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:17,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:17,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:17,679 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:17,680 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:17,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040506827728852626, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05910860479231283, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040506827728852626, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1665, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:17,860 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-12 07:53:17,860 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.1714086515531066, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.040506827728852626, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05910860479231283, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.040506827728852626, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.1665, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23383333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-12 07:53:18,210 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 500 ms to try 5000 different iterations.  Found a solution that moves 2605 regions; Going from a computed imbalance of 0.1714086515531066 to a new imbalance of 0.014936282589119889. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023396579347795755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03573502684564278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28944444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023396579347795755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:18,222 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv841135623:74 , srv245870952:80 , srv323456157:80 , srv898638444:80 , srv156751957:81 , srv834457694:81 , srv1095795985:82 , srv1225533443:82 , srv1347430242:82 , srv1563234535:82 , srv2056858097:82 , srv1107192108:83 , srv1184774767:83 , srv1340569593:83 , srv1444578611:83 , srv1510786178:83 , srv1580222084:83 , srv1597105844:83 , srv1942521221:83 , srv1976621818:83 , srv1987027737:83 , srv1999146511:83 , srv1050565156:84 , srv1165609933:84 , srv1217888679:84 , srv130720582:84 , srv1520745334:84 , srv156229896:84 , srv319007026:84 , srv651992714:84 , srv661394698:84 , srv779638851:84 , srv1128779572:85 , srv1357257721:85 , srv1555951312:85 , srv1978344803:85 , srv347629829:85 , srv748733757:85 , srv870508236:85 , srv971057118:85 , srv1079585059:86 , srv1279174744:86 , srv1308248012:86 , srv1320654357:86 , srv1523260827:86 , srv15897168:86 , srv1779728139:86 , srv1975711878:86 , srv1985002020:86 , srv2059646680:86 , srv218716660:86 , srv259643500:86 , srv41094362:86 , srv739226438:86 , srv745340538:86 , srv772393482:86 , srv992568956:86 , srv1171003963:87 , srv1271916103:87 , srv1298077863:87 , srv1393025142:87 , srv1510579911:87 , srv1686182357:87 , srv1687994565:87 , srv176329502:87 , srv1910886391:87 , srv1992349641:87 , srv2125508262:87 , srv347284036:87 , srv44573892:87 , srv525405794:87 , srv573122959:87 , srv79771143:87 , srv833202178:87 , srv928431703:87 , srv94239986:87 , srv959040137:87 , srv1072970572:88 , srv1323437967:88 , srv1371411653:88 , srv1680524609:88 , srv1872563524:88 , srv187682667:88 , srv2139616464:88 , srv252488325:88 , srv260320426:88 , srv273640428:88 , srv492562350:88 , srv761544430:88 , srv815069787:88 , srv846111028:88 , srv913346790:88 , srv1289216103:89 , srv2052126656:89 , srv465371378:89 , srv909312522:89 , srv1466670860:90 , srv1905703303:90 , srv344415501:91 , srv631386898:532 }
2024-04-12 07:53:18,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:18,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:18,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:18,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:18,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:18,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:18,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:18,257 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:18,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:18,259 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:18,260 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:18,261 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:18,262 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:18,263 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:18,264 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:18,265 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:18,266 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:18,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:18,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:18,267 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:18,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023396579347795755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03573502684564278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023396579347795755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:18,426 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-12 07:53:18,426 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014918041989255731, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.023396579347795755); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03573502684564278, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.023396579347795755); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01175); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04516666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-12 07:53:18,768 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 485 ms to try 5000 different iterations.  Found a solution that moves 977 regions; Going from a computed imbalance of 0.014918041989255731 to a new imbalance of 6.885462798527009E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01039079278184496); MoveCostFunction : (multiplier=7.0, imbalance=0.10855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:18,771 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv909312522:81 , srv748733757:82 , srv1323437967:83 , srv176329502:83 , srv1942521221:83 , srv79771143:83 , srv846111028:83 , srv1279174744:84 , srv1298077863:84 , srv1510786178:84 , srv1520745334:84 , srv1597105844:84 , srv1905703303:84 , srv1976621818:84 , srv1999146511:84 , srv2052126656:84 , srv2139616464:84 , srv260320426:84 , srv323456157:84 , srv41094362:84 , srv739226438:84 , srv745340538:84 , srv928431703:84 , srv971057118:84 , srv992568956:84 , srv1072970572:85 , srv1079585059:85 , srv1308248012:85 , srv1393025142:85 , srv1466670860:85 , srv1555951312:85 , srv1563234535:85 , srv15897168:85 , srv1680524609:85 , srv1779728139:85 , srv1910886391:85 , srv1975711878:85 , srv1978344803:85 , srv2059646680:85 , srv218716660:85 , srv252488325:85 , srv259643500:85 , srv465371378:85 , srv761544430:85 , srv779638851:85 , srv815069787:85 , srv898638444:85 , srv1050565156:86 , srv1271916103:86 , srv1289216103:86 , srv1347430242:86 , srv1357257721:86 , srv1444578611:86 , srv1510579911:86 , srv1523260827:86 , srv156229896:86 , srv156751957:86 , srv1872563524:86 , srv2125508262:86 , srv245870952:86 , srv273640428:86 , srv344415501:86 , srv347629829:86 , srv525405794:86 , srv573122959:86 , srv661394698:86 , srv913346790:86 , srv959040137:86 , srv1128779572:87 , srv1165609933:87 , srv1171003963:87 , srv1184774767:87 , srv130720582:87 , srv1320654357:87 , srv1340569593:87 , srv1371411653:87 , srv1687994565:87 , srv187682667:87 , srv1987027737:87 , srv1992349641:87 , srv2056858097:87 , srv347284036:87 , srv44573892:87 , srv492562350:87 , srv772393482:87 , srv841135623:87 , srv870508236:87 , srv94239986:87 , srv1095795985:88 , srv1107192108:88 , srv1217888679:88 , srv1225533443:88 , srv1580222084:88 , srv1686182357:88 , srv1985002020:88 , srv319007026:88 , srv651992714:88 , srv833202178:88 , srv834457694:88 , srv631386898:526 }
2024-04-12 07:53:18,775 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:18,776 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:18,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:18,791 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:18,792 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:18,793 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:18,794 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:18,795 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:18,796 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:18,797 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:18,798 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:18,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:18,800 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:18,801 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:18,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01039079278184496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:18,945 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-12 07:53:18,945 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.817051796349339E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0056567660698823964); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.01039079278184496); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0056567660698823964); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00425); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-12 07:53:19,361 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 544 ms to try 5000 different iterations.  Found a solution that moves 277 regions; Going from a computed imbalance of 6.817051796349339E-4 to a new imbalance of 5.318847328657094E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.03077777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:19,362 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1217888679:83 , srv1987027737:83 , srv1992349641:83 , srv344415501:83 , srv1128779572:84 , srv1165609933:84 , srv1171003963:84 , srv1184774767:84 , srv1225533443:84 , srv1289216103:84 , srv130720582:84 , srv1320654357:84 , srv1357257721:84 , srv1371411653:84 , srv1393025142:84 , srv1510786178:84 , srv1520745334:84 , srv156229896:84 , srv156751957:84 , srv1686182357:84 , srv176329502:84 , srv1779728139:84 , srv187682667:84 , srv1910886391:84 , srv1942521221:84 , srv1975711878:84 , srv1985002020:84 , srv1999146511:84 , srv2056858097:84 , srv218716660:84 , srv245870952:84 , srv252488325:84 , srv260320426:84 , srv273640428:84 , srv319007026:84 , srv347629829:84 , srv492562350:84 , srv573122959:84 , srv651992714:84 , srv661394698:84 , srv761544430:84 , srv772393482:84 , srv779638851:84 , srv79771143:84 , srv815069787:84 , srv833202178:84 , srv870508236:84 , srv898638444:84 , srv94239986:84 , srv959040137:84 , srv992568956:84 , srv1050565156:85 , srv1072970572:85 , srv1079585059:85 , srv1095795985:85 , srv1107192108:85 , srv1271916103:85 , srv1279174744:85 , srv1298077863:85 , srv1308248012:85 , srv1323437967:85 , srv1340569593:85 , srv1347430242:85 , srv1466670860:85 , srv1510579911:85 , srv1523260827:85 , srv1555951312:85 , srv1563234535:85 , srv1580222084:85 , srv15897168:85 , srv1680524609:85 , srv1687994565:85 , srv1872563524:85 , srv1905703303:85 , srv1976621818:85 , srv1978344803:85 , srv2059646680:85 , srv2125508262:85 , srv2139616464:85 , srv259643500:85 , srv323456157:85 , srv347284036:85 , srv41094362:85 , srv44573892:85 , srv525405794:85 , srv739226438:85 , srv745340538:85 , srv748733757:85 , srv834457694:85 , srv841135623:85 , srv913346790:85 , srv928431703:85 , srv971057118:85 , srv1444578611:86 , srv1597105844:86 , srv2052126656:86 , srv465371378:86 , srv846111028:86 , srv909312522:86 , srv631386898:634 }
2024-04-12 07:53:19,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:19,366 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:19,377 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:19,378 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:19,379 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:19,380 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:19,381 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:19,382 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:19,383 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:19,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:19,489 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2024-04-12 07:53:19,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.124887783076601E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0026378918903435544); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=4.166666666666667E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2024-04-12 07:53:19,748 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 356 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 5.124887783076601E-5 to a new imbalance of 7.948501337768768E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:19,748 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1072970572:83 , srv2139616464:83 , srv347284036:83 , srv465371378:83 , srv846111028:83 , srv909312522:83 , srv1050565156:84 , srv1079585059:84 , srv1095795985:84 , srv1107192108:84 , srv1128779572:84 , srv1165609933:84 , srv1171003963:84 , srv1184774767:84 , srv1217888679:84 , srv1225533443:84 , srv1271916103:84 , srv1279174744:84 , srv1289216103:84 , srv130720582:84 , srv1308248012:84 , srv1320654357:84 , srv1323437967:84 , srv1340569593:84 , srv1347430242:84 , srv1357257721:84 , srv1371411653:84 , srv1393025142:84 , srv1444578611:84 , srv1466670860:84 , srv1510579911:84 , srv1510786178:84 , srv1520745334:84 , srv1523260827:84 , srv1555951312:84 , srv156229896:84 , srv1563234535:84 , srv156751957:84 , srv1580222084:84 , srv15897168:84 , srv1597105844:84 , srv1680524609:84 , srv1686182357:84 , srv1687994565:84 , srv1779728139:84 , srv1872563524:84 , srv187682667:84 , srv1905703303:84 , srv1910886391:84 , srv1975711878:84 , srv1976621818:84 , srv1978344803:84 , srv1985002020:84 , srv1987027737:84 , srv1992349641:84 , srv1999146511:84 , srv2052126656:84 , srv2056858097:84 , srv2059646680:84 , srv2125508262:84 , srv218716660:84 , srv245870952:84 , srv259643500:84 , srv260320426:84 , srv273640428:84 , srv319007026:84 , srv323456157:84 , srv344415501:84 , srv347629829:84 , srv41094362:84 , srv44573892:84 , srv492562350:84 , srv525405794:84 , srv573122959:84 , srv651992714:84 , srv661394698:84 , srv739226438:84 , srv745340538:84 , srv748733757:84 , srv761544430:84 , srv772393482:84 , srv79771143:84 , srv815069787:84 , srv833202178:84 , srv834457694:84 , srv841135623:84 , srv870508236:84 , srv913346790:84 , srv928431703:84 , srv94239986:84 , srv959040137:84 , srv971057118:84 , srv992568956:84 , srv1298077863:85 , srv176329502:85 , srv1942521221:85 , srv252488325:85 , srv779638851:85 , srv898638444:85 , srv631386898:684 }
2024-04-12 07:53:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:19,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv156751957=33, srv870508236=91, srv187682667=43, srv2059646680=56, srv319007026=65, srv1279174744=12, srv525405794=74, srv344415501=67, srv260320426=63, srv651992714=77, srv833202178=87, srv1357257721=21, srv1687994565=39, srv928431703=95, srv1289216103=13, srv1128779572=5, srv834457694=88, srv1942521221=46, srv245870952=60, srv492562350=73, srv15897168=35, srv1992349641=52, srv465371378=72, srv1371411653=22, srv1184774767=8, srv79771143=85, srv1217888679=9, srv156229896=31, srv1779728139=41, srv1905703303=44, srv1298077863=14, srv1987027737=51, srv1308248012=16, srv1072970572=1, srv347284036=68, srv631386898=76, srv1225533443=10, srv1340569593=19, srv41094362=70, srv1686182357=38, srv44573892=71, srv1520745334=28, srv841135623=89, srv1597105844=36, srv2125508262=57, srv1510579911=26, srv1444578611=24, srv2139616464=58, srv1323437967=18, srv745340538=80, srv1347430242=20, srv1872563524=42, srv1910886391=45, srv1580222084=34, srv130720582=15, srv323456157=66, srv1975711878=47, srv909312522=93, srv259643500=62, srv1165609933=6, srv748733757=81, srv913346790=94, srv1563234535=32, srv1978344803=49, srv959040137=97, srv347629829=69, srv739226438=79, srv1271916103=11, srv573122959=75, srv971057118=98, srv1050565156=0, srv1510786178=27, srv992568956=99, srv1985002020=50, srv252488325=61, srv218716660=59, srv94239986=96, srv1466670860=25, srv1523260827=29, srv2056858097=55, srv898638444=92, srv761544430=82, srv779638851=84, srv846111028=90, srv2052126656=54, srv273640428=64, srv1079585059=2, srv1976621818=48, srv1320654357=17, srv1393025142=23, srv1095795985=3, srv1107192108=4, srv176329502=40, srv815069787=86, srv661394698=78, srv1999146511=53, srv1680524609=37, srv1555951312=30, srv772393482=83, srv1171003963=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:19,763 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2024-04-12 07:53:19,764 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2024-04-12 07:53:19,765 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2024-04-12 07:53:19,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2024-04-12 07:53:19,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2024-04-12 07:53:19,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2024-04-12 07:53:19,876 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.689421800350782E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0017082358106351274); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:19,876 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1072970572:83 , srv2139616464:83 , srv347284036:83 , srv465371378:83 , srv846111028:83 , srv909312522:83 , srv1050565156:84 , srv1079585059:84 , srv1095795985:84 , srv1107192108:84 , srv1128779572:84 , srv1165609933:84 , srv1171003963:84 , srv1184774767:84 , srv1217888679:84 , srv1225533443:84 , srv1271916103:84 , srv1279174744:84 , srv1289216103:84 , srv130720582:84 , srv1308248012:84 , srv1320654357:84 , srv1323437967:84 , srv1340569593:84 , srv1347430242:84 , srv1357257721:84 , srv1371411653:84 , srv1393025142:84 , srv1444578611:84 , srv1466670860:84 , srv1510579911:84 , srv1510786178:84 , srv1520745334:84 , srv1523260827:84 , srv1555951312:84 , srv156229896:84 , srv1563234535:84 , srv156751957:84 , srv1580222084:84 , srv15897168:84 , srv1597105844:84 , srv1680524609:84 , srv1686182357:84 , srv1687994565:84 , srv1779728139:84 , srv1872563524:84 , srv187682667:84 , srv1905703303:84 , srv1910886391:84 , srv1975711878:84 , srv1976621818:84 , srv1978344803:84 , srv1985002020:84 , srv1987027737:84 , srv1992349641:84 , srv1999146511:84 , srv2052126656:84 , srv2056858097:84 , srv2059646680:84 , srv2125508262:84 , srv218716660:84 , srv245870952:84 , srv259643500:84 , srv260320426:84 , srv273640428:84 , srv319007026:84 , srv323456157:84 , srv344415501:84 , srv347629829:84 , srv41094362:84 , srv44573892:84 , srv492562350:84 , srv525405794:84 , srv573122959:84 , srv651992714:84 , srv661394698:84 , srv739226438:84 , srv745340538:84 , srv748733757:84 , srv761544430:84 , srv772393482:84 , srv79771143:84 , srv815069787:84 , srv833202178:84 , srv834457694:84 , srv841135623:84 , srv870508236:84 , srv913346790:84 , srv928431703:84 , srv94239986:84 , srv959040137:84 , srv971057118:84 , srv992568956:84 , srv1298077863:85 , srv176329502:85 , srv1942521221:85 , srv252488325:85 , srv779638851:85 , srv898638444:85 , srv631386898:684 }
2024-04-12 07:53:19,904 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=423 (was 347) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=8424 (was 9174)
2024-04-12 07:53:19,912 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=290, MaxFileDescriptor=60000, SystemLoadAverage=423, ProcessCount=171, AvailableMemoryMB=8424
2024-04-12 07:53:19,913 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2024-04-12 07:53:19,913 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2024-04-12 07:53:19,924 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1017459332:84 , srv102954746:84 , srv1036017722:84 , srv1133963933:84 , srv1134435296:84 , srv1177061255:84 , srv1194949578:84 , srv1203281606:84 , srv1226591291:84 , srv1231881652:84 , srv1242595193:84 , srv1340924178:84 , srv1371956793:84 , srv1372650415:84 , srv1398912214:84 , srv1499276145:84 , srv1502925550:84 , srv1547636218:84 , srv1705817920:84 , srv1825646499:84 , srv1882486:84 , srv1901736802:84 , srv2075213973:84 , srv418152018:84 , srv461389791:84 , srv708592028:84 , srv802866990:84 , srv9731746:84 , srv986658227:84 , srv1482845121:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2024-04-12 07:53:19,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:53:19,925 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1133963933=3, srv1372650415=13, srv1231881652=9, srv1398912214=14, srv1340924178=11, srv1499276145=16, srv1825646499=20, srv1882486=21, srv1502925550=17, srv1705817920=19, srv461389791=25, srv1242595193=10, srv1017459332=0, srv2075213973=23, srv1547636218=18, srv708592028=26, srv9731746=28, srv1194949578=6, srv986658227=29, srv1177061255=5, srv1371956793=12, srv1203281606=7, srv102954746=1, srv802866990=27, srv418152018=24, srv1901736802=22, srv1036017722=2, srv1134435296=4, srv1226591291=8, srv1482845121=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:53:19,934 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:53:19,935 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-12 07:53:19,947 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0921324548335236, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:53:19,947 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912483349621058, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0921324548335236, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2024-04-12 07:55:19,938 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5248726 different iterations.  Found a solution that moves 1863 regions; Going from a computed imbalance of 0.9912483349621058 to a new imbalance of 4.3483349388262195E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.69, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:55:19,946 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1017459332:90 , srv102954746:90 , srv1036017722:90 , srv1133963933:90 , srv1134435296:90 , srv1177061255:90 , srv1194949578:90 , srv1203281606:90 , srv1226591291:90 , srv1231881652:90 , srv1242595193:90 , srv1340924178:90 , srv1371956793:90 , srv1372650415:90 , srv1398912214:90 , srv1482845121:90 , srv1499276145:90 , srv1502925550:90 , srv1547636218:90 , srv1705817920:90 , srv1825646499:90 , srv1882486:90 , srv1901736802:90 , srv2075213973:90 , srv418152018:90 , srv461389791:90 , srv708592028:90 , srv802866990:90 , srv9731746:90 , srv986658227:90 }
2024-04-12 07:55:19,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2024-04-12 07:55:19,947 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1133963933=3, srv1372650415=13, srv1231881652=9, srv1398912214=14, srv1340924178=11, srv1499276145=16, srv1825646499=20, srv1882486=21, srv1502925550=17, srv1705817920=19, srv461389791=25, srv1242595193=10, srv1017459332=0, srv2075213973=23, srv1547636218=18, srv708592028=26, srv9731746=28, srv1194949578=6, srv986658227=29, srv1177061255=5, srv1371956793=12, srv1203281606=7, srv102954746=1, srv802866990=27, srv418152018=24, srv1901736802=22, srv1036017722=2, srv1134435296=4, srv1226591291=8, srv1482845121=15} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2024-04-12 07:55:19,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2024-04-12 07:55:19,953 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2024-04-12 07:55:19,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2024-04-12 07:55:19,972 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2024-04-12 07:55:19,972 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1017459332:90 , srv102954746:90 , srv1036017722:90 , srv1133963933:90 , srv1134435296:90 , srv1177061255:90 , srv1194949578:90 , srv1203281606:90 , srv1226591291:90 , srv1231881652:90 , srv1242595193:90 , srv1340924178:90 , srv1371956793:90 , srv1372650415:90 , srv1398912214:90 , srv1482845121:90 , srv1499276145:90 , srv1502925550:90 , srv1547636218:90 , srv1705817920:90 , srv1825646499:90 , srv1882486:90 , srv1901736802:90 , srv2075213973:90 , srv418152018:90 , srv461389791:90 , srv708592028:90 , srv802866990:90 , srv9731746:90 , srv986658227:90 }
2024-04-12 07:55:19,988 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=290 (was 290), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 423), ProcessCount=167 (was 171), AvailableMemoryMB=7667 (was 8424)