2023-03-31 18:55:56,716 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-31 18:55:57,133 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-31 18:55:57,265 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-31 18:55:57,339 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-31 18:55:57,347 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-31 18:55:57,363 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=169, AvailableMemoryMB=4323
2023-03-31 18:55:57,365 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-31 18:55:57,365 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-31 18:55:57,520 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1019530537:84 , srv1032846256:84 , srv1036610461:84 , srv1047364737:84 , srv1078935079:84 , srv1094250623:84 , srv1101969877:84 , srv1133215541:84 , srv1134834145:84 , srv1183666081:84 , srv1190526737:84 , srv1229532336:84 , srv1287692871:84 , srv1306593373:84 , srv136059846:84 , srv1406274180:84 , srv143901754:84 , srv1439426791:84 , srv1455877755:84 , srv1473282599:84 , srv1481198361:84 , srv1498294705:84 , srv150577390:84 , srv1511635995:84 , srv1516467179:84 , srv1516770285:84 , srv1517788757:84 , srv155089398:84 , srv1558759058:84 , srv1559621603:84 , srv1560242517:84 , srv1562322925:84 , srv1570634396:84 , srv1608840012:84 , srv1646332523:84 , srv1694004999:84 , srv1700677515:84 , srv1777190528:84 , srv1778896627:84 , srv1786055487:84 , srv1810937983:84 , srv1816583233:84 , srv1831420991:84 , srv1836040099:84 , srv183968831:84 , srv1841288229:84 , srv1877530003:84 , srv1882022503:84 , srv1925074716:84 , srv1935875097:84 , srv1955684004:84 , srv1973464757:84 , srv1991948535:84 , srv2012559399:84 , srv2063478686:84 , srv2069384481:84 , srv2097845493:84 , srv2111564490:84 , srv211599223:84 , srv212931940:84 , srv249625536:84 , srv256559918:84 , srv296199588:84 , srv311126410:84 , srv341488912:84 , srv346743739:84 , srv3695270:84 , srv404474616:84 , srv476940315:84 , srv495801264:84 , srv51443892:84 , srv524876368:84 , srv527561068:84 , srv536113285:84 , srv593191183:84 , srv631950882:84 , srv639908771:84 , srv674775889:84 , srv674881286:84 , srv708777457:84 , srv753222759:84 , srv770543058:84 , srv780546382:84 , srv818366806:84 , srv819651413:84 , srv833051794:84 , srv881786818:84 , srv894753328:84 , srv89554427:84 , srv901078914:84 , srv902500444:84 , srv909549804:84 , srv909673342:84 , srv931307932:84 , srv93974839:84 , srv944266636:84 , srv966890193:84 , srv978028748:84 , srv981097644:84 , srv1036462273:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-31 18:55:57,535 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:55:57,547 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:55:57,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:55:57,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:55:57,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:55:57,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:55:57,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:55:57,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:55:57,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:55:57,674 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:55:57,675 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:55:57,676 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:55:57,677 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:55:57,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:55:57,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:55:57,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:55:57,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:55:57,678 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:55:58,147 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:55:58,148 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-31 18:55:58,148 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-31 18:55:59,059 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1342 ms to try 5000 different iterations.  Found a solution that moves 4678 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1835703184214329. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03726027001594399, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05540180745571636, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5197777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03726027001594399, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17916666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:55:59,103 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1700677515:82 , srv211599223:82 , srv89554427:82 , srv1439426791:83 , srv1517788757:83 , srv1841288229:83 , srv1955684004:83 , srv2111564490:83 , srv346743739:83 , srv3695270:83 , srv753222759:83 , srv818366806:83 , srv143901754:84 , srv1511635995:84 , srv1646332523:84 , srv1694004999:84 , srv2097845493:84 , srv527561068:84 , srv631950882:84 , srv881786818:84 , srv909549804:84 , srv909673342:84 , srv93974839:84 , srv1047364737:85 , srv1516770285:85 , srv2063478686:85 , srv256559918:85 , srv296199588:85 , srv311126410:85 , srv978028748:85 , srv981097644:85 , srv1019530537:86 , srv1032846256:86 , srv1078935079:86 , srv1306593373:86 , srv136059846:86 , srv1455877755:86 , srv1473282599:86 , srv1559621603:86 , srv1562322925:86 , srv1786055487:86 , srv1810937983:86 , srv183968831:86 , srv2012559399:86 , srv2069384481:86 , srv476940315:86 , srv639908771:86 , srv1036610461:87 , srv1101969877:87 , srv1287692871:87 , srv1406274180:87 , srv1558759058:87 , srv1778896627:87 , srv1816583233:87 , srv1831420991:87 , srv1877530003:87 , srv1925074716:87 , srv1935875097:87 , srv1973464757:87 , srv249625536:87 , srv404474616:87 , srv524876368:87 , srv593191183:87 , srv819651413:87 , srv833051794:87 , srv902500444:87 , srv931307932:87 , srv1183666081:88 , srv1229532336:88 , srv1498294705:88 , srv150577390:88 , srv155089398:88 , srv1560242517:88 , srv51443892:88 , srv674775889:88 , srv780546382:88 , srv901078914:88 , srv1133215541:89 , srv1608840012:89 , srv1777190528:89 , srv1836040099:89 , srv341488912:89 , srv708777457:89 , srv770543058:89 , srv944266636:89 , srv966890193:89 , srv1094250623:90 , srv1134834145:90 , srv1570634396:90 , srv1882022503:90 , srv1991948535:90 , srv212931940:90 , srv894753328:90 , srv1481198361:91 , srv674881286:91 , srv1190526737:92 , srv1516467179:92 , srv536113285:93 , srv495801264:96 , srv1036462273:421 }
2023-03-31 18:55:59,109 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:55:59,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:55:59,143 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:55:59,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:55:59,144 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:55:59,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:55:59,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:55:59,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:55:59,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:55:59,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:55:59,147 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:55:59,148 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:55:59,149 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:55:59,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:55:59,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:55:59,152 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:55:59,153 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:55:59,154 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:55:59,155 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:55:59,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:55:59,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:55:59,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:55:59,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:55:59,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:55:59,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:55:59,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:55:59,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:55:59,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:55:59,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:55:59,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:55:59,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:55:59,359 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03726027001594399, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05540180745571636, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03726027001594399, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17916666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:55:59,359 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-31 18:55:59,360 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18353756236532368, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03726027001594399, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05540180745571636, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03726027001594399, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17916666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24225, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-31 18:55:59,738 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 2641 regions; Going from a computed imbalance of 0.18353756236532368 to a new imbalance of 0.015169771414107325. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021709000629180176); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037688545834154354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29344444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021709000629180176); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04108333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:55:59,752 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv495801264:77 , srv536113285:77 , srv1570634396:80 , srv894753328:80 , srv1481198361:81 , srv1516467179:81 , srv1094250623:82 , srv1229532336:82 , srv1406274180:82 , srv1777190528:82 , srv341488912:82 , srv674881286:82 , srv770543058:82 , srv780546382:82 , srv1134834145:83 , srv1183666081:83 , srv1190526737:83 , srv1498294705:83 , srv1836040099:83 , srv212931940:83 , srv966890193:83 , srv1036610461:84 , srv1078935079:84 , srv1287692871:84 , srv1306593373:84 , srv1455877755:84 , srv150577390:84 , srv1560242517:84 , srv1608840012:84 , srv183968831:84 , srv1877530003:84 , srv1882022503:84 , srv1925074716:84 , srv1991948535:84 , srv51443892:84 , srv708777457:84 , srv902500444:84 , srv944266636:84 , srv1101969877:85 , srv1133215541:85 , srv136059846:85 , srv1473282599:85 , srv1558759058:85 , srv1778896627:85 , srv1786055487:85 , srv1831420991:85 , srv1973464757:85 , srv249625536:85 , srv404474616:85 , srv593191183:85 , srv639908771:85 , srv674775889:85 , srv833051794:85 , srv901078914:85 , srv1019530537:86 , srv1032846256:86 , srv1516770285:86 , srv155089398:86 , srv1810937983:86 , srv1816583233:86 , srv1935875097:86 , srv2012559399:86 , srv2063478686:86 , srv311126410:86 , srv524876368:86 , srv819651413:86 , srv1511635995:87 , srv1562322925:87 , srv1646332523:87 , srv1841288229:87 , srv2069384481:87 , srv2111564490:87 , srv909673342:87 , srv931307932:87 , srv1439426791:88 , srv1517788757:88 , srv1559621603:88 , srv3695270:88 , srv476940315:88 , srv631950882:88 , srv753222759:88 , srv881786818:88 , srv1047364737:89 , srv1700677515:89 , srv1955684004:89 , srv2097845493:89 , srv256559918:89 , srv296199588:89 , srv527561068:89 , srv909549804:89 , srv93974839:89 , srv978028748:89 , srv981097644:89 , srv143901754:90 , srv1694004999:90 , srv346743739:90 , srv818366806:90 , srv211599223:91 , srv89554427:91 , srv1036462273:546 }
2023-03-31 18:55:59,759 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:55:59,762 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:55:59,780 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:55:59,781 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:55:59,782 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:55:59,783 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:55:59,784 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:55:59,785 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:55:59,786 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:55:59,787 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:55:59,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:55:59,789 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:55:59,790 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:55:59,986 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021709000629180176); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037688545834154354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021709000629180176); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04108333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:55:59,987 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-31 18:55:59,987 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.015151278736855409, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021709000629180176); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037688545834154354, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021709000629180176); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.012416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04108333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-31 18:56:00,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 976 regions; Going from a computed imbalance of 0.015151278736855409 to a new imbalance of 6.641857027262936E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005543196128553987); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.10844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005543196128553987); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:00,310 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1694004999:82 , srv1190526737:83 , srv296199588:83 , srv476940315:83 , srv931307932:83 , srv1047364737:84 , srv1133215541:84 , srv143901754:84 , srv1559621603:84 , srv1608840012:84 , srv1816583233:84 , srv1991948535:84 , srv2069384481:84 , srv2097845493:84 , srv211599223:84 , srv256559918:84 , srv524876368:84 , srv674775889:84 , srv708777457:84 , srv901078914:84 , srv909549804:84 , srv93974839:84 , srv944266636:84 , srv978028748:84 , srv981097644:84 , srv1019530537:85 , srv1101969877:85 , srv1134834145:85 , srv150577390:85 , srv1516467179:85 , srv155089398:85 , srv1558759058:85 , srv1562322925:85 , srv1778896627:85 , srv1836040099:85 , srv1882022503:85 , srv1935875097:85 , srv1955684004:85 , srv1973464757:85 , srv2012559399:85 , srv212931940:85 , srv249625536:85 , srv346743739:85 , srv674881286:85 , srv818366806:85 , srv819651413:85 , srv881786818:85 , srv89554427:85 , srv1032846256:86 , srv1036610461:86 , srv1094250623:86 , srv1473282599:86 , srv1481198361:86 , srv1498294705:86 , srv1511635995:86 , srv1516770285:86 , srv1517788757:86 , srv1560242517:86 , srv1646332523:86 , srv1700677515:86 , srv1777190528:86 , srv1786055487:86 , srv1810937983:86 , srv1831420991:86 , srv1925074716:86 , srv2063478686:86 , srv311126410:86 , srv3695270:86 , srv404474616:86 , srv51443892:86 , srv527561068:86 , srv593191183:86 , srv631950882:86 , srv770543058:86 , srv833051794:86 , srv909673342:86 , srv966890193:86 , srv1078935079:87 , srv1183666081:87 , srv1287692871:87 , srv1306593373:87 , srv136059846:87 , srv1439426791:87 , srv1455877755:87 , srv1570634396:87 , srv183968831:87 , srv1841288229:87 , srv1877530003:87 , srv2111564490:87 , srv341488912:87 , srv495801264:87 , srv536113285:87 , srv639908771:87 , srv753222759:87 , srv780546382:87 , srv902500444:87 , srv1229532336:88 , srv1406274180:88 , srv894753328:88 , srv1036462273:540 }
2023-03-31 18:56:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:56:00,314 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:56:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:56:00,338 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:56:00,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:56:00,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:56:00,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:56:00,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:56:00,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:56:00,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:56:00,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:56:00,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:56:00,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:56:00,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:56:00,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005543196128553987); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005543196128553987); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:00,510 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-31 18:56:00,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.573516046581865E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005543196128553987); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00843540185701534); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005543196128553987); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00325); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-31 18:56:00,852 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 481 ms to try 5000 different iterations.  Found a solution that moves 214 regions; Going from a computed imbalance of 6.573516046581865E-4 to a new imbalance of 2.5588794905418134E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.023777777777777776); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:00,853 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv495801264:82 , srv1183666081:83 , srv1229532336:83 , srv1882022503:83 , srv256559918:83 , srv527561068:83 , srv833051794:83 , srv978028748:83 , srv1032846256:84 , srv1036610461:84 , srv1047364737:84 , srv1094250623:84 , srv1133215541:84 , srv1134834145:84 , srv1190526737:84 , srv1287692871:84 , srv136059846:84 , srv143901754:84 , srv1439426791:84 , srv1481198361:84 , srv155089398:84 , srv1559621603:84 , srv1560242517:84 , srv1562322925:84 , srv1810937983:84 , srv1831420991:84 , srv1877530003:84 , srv1935875097:84 , srv1991948535:84 , srv212931940:84 , srv341488912:84 , srv346743739:84 , srv404474616:84 , srv51443892:84 , srv593191183:84 , srv631950882:84 , srv639908771:84 , srv674881286:84 , srv753222759:84 , srv770543058:84 , srv818366806:84 , srv819651413:84 , srv894753328:84 , srv89554427:84 , srv902500444:84 , srv966890193:84 , srv1019530537:85 , srv1078935079:85 , srv1101969877:85 , srv1306593373:85 , srv1455877755:85 , srv1473282599:85 , srv1498294705:85 , srv150577390:85 , srv1511635995:85 , srv1516467179:85 , srv1516770285:85 , srv1517788757:85 , srv1558759058:85 , srv1570634396:85 , srv1608840012:85 , srv1646332523:85 , srv1700677515:85 , srv1777190528:85 , srv1816583233:85 , srv1836040099:85 , srv183968831:85 , srv1841288229:85 , srv1925074716:85 , srv1955684004:85 , srv1973464757:85 , srv2012559399:85 , srv2063478686:85 , srv2069384481:85 , srv2097845493:85 , srv2111564490:85 , srv211599223:85 , srv249625536:85 , srv296199588:85 , srv311126410:85 , srv3695270:85 , srv524876368:85 , srv536113285:85 , srv674775889:85 , srv708777457:85 , srv780546382:85 , srv881786818:85 , srv901078914:85 , srv909549804:85 , srv909673342:85 , srv931307932:85 , srv93974839:85 , srv944266636:85 , srv981097644:85 , srv1406274180:86 , srv1694004999:86 , srv1778896627:86 , srv1786055487:86 , srv476940315:86 , srv1036462273:635 }
2023-03-31 18:56:00,859 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:56:00,860 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:56:00,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:56:00,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:56:00,877 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:56:00,878 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:56:00,879 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:56:00,880 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:56:00,881 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:56:00,882 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:56:00,883 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:56:00,884 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:56:01,047 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:01,048 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-31 18:56:01,048 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.4090334878189775E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-31 18:56:01,337 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 431 ms to try 5000 different iterations.  Found a solution that moves 19 regions; Going from a computed imbalance of 2.4090334878189775E-5 to a new imbalance of 5.775533837065641E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.002111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:01,338 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1406274180:83 , srv1516467179:83 , srv155089398:83 , srv1778896627:83 , srv1786055487:83 , srv476940315:83 , srv981097644:83 , srv1019530537:84 , srv1032846256:84 , srv1047364737:84 , srv1078935079:84 , srv1094250623:84 , srv1101969877:84 , srv1133215541:84 , srv1134834145:84 , srv1190526737:84 , srv1287692871:84 , srv1306593373:84 , srv136059846:84 , srv143901754:84 , srv1439426791:84 , srv1455877755:84 , srv1473282599:84 , srv1481198361:84 , srv1498294705:84 , srv150577390:84 , srv1511635995:84 , srv1516770285:84 , srv1517788757:84 , srv1558759058:84 , srv1559621603:84 , srv1560242517:84 , srv1562322925:84 , srv1570634396:84 , srv1608840012:84 , srv1646332523:84 , srv1694004999:84 , srv1700677515:84 , srv1777190528:84 , srv1810937983:84 , srv1816583233:84 , srv1831420991:84 , srv1836040099:84 , srv183968831:84 , srv1841288229:84 , srv1877530003:84 , srv1882022503:84 , srv1925074716:84 , srv1935875097:84 , srv1955684004:84 , srv1973464757:84 , srv1991948535:84 , srv2012559399:84 , srv2063478686:84 , srv2069384481:84 , srv2097845493:84 , srv2111564490:84 , srv211599223:84 , srv212931940:84 , srv249625536:84 , srv296199588:84 , srv311126410:84 , srv341488912:84 , srv346743739:84 , srv3695270:84 , srv404474616:84 , srv495801264:84 , srv51443892:84 , srv524876368:84 , srv527561068:84 , srv536113285:84 , srv593191183:84 , srv631950882:84 , srv639908771:84 , srv674775889:84 , srv674881286:84 , srv708777457:84 , srv753222759:84 , srv780546382:84 , srv818366806:84 , srv819651413:84 , srv881786818:84 , srv894753328:84 , srv89554427:84 , srv901078914:84 , srv902500444:84 , srv909549804:84 , srv909673342:84 , srv931307932:84 , srv93974839:84 , srv944266636:84 , srv966890193:84 , srv1036610461:85 , srv1183666081:85 , srv1229532336:85 , srv256559918:85 , srv770543058:85 , srv833051794:85 , srv978028748:85 , srv1036462273:684 }
2023-03-31 18:56:01,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:56:01,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1229532336=12, srv1882022503=48, srv143901754=17, srv1955684004=51, srv1473282599=20, srv1560242517=31, srv51443892=71, srv674775889=78, srv1190526737=11, srv1836040099=44, srv3695270=67, srv1287692871=13, srv1516770285=26, srv2012559399=54, srv1991948535=53, srv212931940=60, srv476940315=69, srv1562322925=32, srv1047364737=4, srv1481198361=21, srv818366806=84, srv978028748=98, srv1306593373=14, srv2063478686=55, srv631950882=76, srv1094250623=6, srv770543058=82, srv249625536=61, srv1877530003=47, srv1406274180=16, srv211599223=59, srv1032846256=1, srv136059846=15, srv902500444=91, srv1816583233=42, srv1439426791=18, srv1935875097=50, srv1101969877=7, srv1078935079=5, srv256559918=62, srv1036462273=2, srv89554427=89, srv1516467179=25, srv1810937983=41, srv1831420991=43, srv909549804=92, srv1517788757=27, srv404474616=68, srv1608840012=34, srv527561068=73, srv593191183=75, srv346743739=66, srv155089398=28, srv536113285=74, srv708777457=80, srv524876368=72, srv1925074716=49, srv1134834145=9, srv1646332523=35, srv1841288229=46, srv1973464757=52, srv1777190528=38, srv2097845493=57, srv639908771=77, srv780546382=83, srv944266636=96, srv1778896627=39, srv966890193=97, srv1511635995=24, srv1498294705=22, srv495801264=70, srv1455877755=19, srv981097644=99, srv1570634396=33, srv894753328=88, srv1019530537=0, srv901078914=90, srv2111564490=58, srv2069384481=56, srv1036610461=3, srv674881286=79, srv296199588=63, srv1559621603=30, srv833051794=86, srv1786055487=40, srv183968831=45, srv1558759058=29, srv1183666081=10, srv341488912=65, srv1700677515=37, srv1694004999=36, srv931307932=94, srv1133215541=8, srv819651413=85, srv909673342=93, srv881786818=87, srv150577390=23, srv311126410=64, srv93974839=95, srv753222759=81} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:56:01,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:56:01,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-31 18:56:01,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-31 18:56:01,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-31 18:56:01,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-31 18:56:01,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-31 18:56:01,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-31 18:56:01,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-31 18:56:01,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-31 18:56:01,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-31 18:56:01,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-31 18:56:01,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-31 18:56:01,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=5.642492993526674E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0012535023884839248); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:01,490 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1406274180:83 , srv1516467179:83 , srv155089398:83 , srv1778896627:83 , srv1786055487:83 , srv476940315:83 , srv981097644:83 , srv1019530537:84 , srv1032846256:84 , srv1047364737:84 , srv1078935079:84 , srv1094250623:84 , srv1101969877:84 , srv1133215541:84 , srv1134834145:84 , srv1190526737:84 , srv1287692871:84 , srv1306593373:84 , srv136059846:84 , srv143901754:84 , srv1439426791:84 , srv1455877755:84 , srv1473282599:84 , srv1481198361:84 , srv1498294705:84 , srv150577390:84 , srv1511635995:84 , srv1516770285:84 , srv1517788757:84 , srv1558759058:84 , srv1559621603:84 , srv1560242517:84 , srv1562322925:84 , srv1570634396:84 , srv1608840012:84 , srv1646332523:84 , srv1694004999:84 , srv1700677515:84 , srv1777190528:84 , srv1810937983:84 , srv1816583233:84 , srv1831420991:84 , srv1836040099:84 , srv183968831:84 , srv1841288229:84 , srv1877530003:84 , srv1882022503:84 , srv1925074716:84 , srv1935875097:84 , srv1955684004:84 , srv1973464757:84 , srv1991948535:84 , srv2012559399:84 , srv2063478686:84 , srv2069384481:84 , srv2097845493:84 , srv2111564490:84 , srv211599223:84 , srv212931940:84 , srv249625536:84 , srv296199588:84 , srv311126410:84 , srv341488912:84 , srv346743739:84 , srv3695270:84 , srv404474616:84 , srv495801264:84 , srv51443892:84 , srv524876368:84 , srv527561068:84 , srv536113285:84 , srv593191183:84 , srv631950882:84 , srv639908771:84 , srv674775889:84 , srv674881286:84 , srv708777457:84 , srv753222759:84 , srv780546382:84 , srv818366806:84 , srv819651413:84 , srv881786818:84 , srv894753328:84 , srv89554427:84 , srv901078914:84 , srv902500444:84 , srv909549804:84 , srv909673342:84 , srv931307932:84 , srv93974839:84 , srv944266636:84 , srv966890193:84 , srv1036610461:85 , srv1183666081:85 , srv1229532336:85 , srv256559918:85 , srv770543058:85 , srv833051794:85 , srv978028748:85 , srv1036462273:684 }
2023-03-31 18:56:01,521 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=343 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3822 (was 4323)
2023-03-31 18:56:01,532 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=343, ProcessCount=169, AvailableMemoryMB=3821
2023-03-31 18:56:01,533 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-31 18:56:01,533 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-31 18:56:01,547 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1073770020:84 , srv1204262588:84 , srv1289079462:84 , srv1486417201:84 , srv1502154246:84 , srv1570151925:84 , srv1597165578:84 , srv1697246706:84 , srv1746473705:84 , srv1852852537:84 , srv1877550969:84 , srv198673701:84 , srv2062610252:84 , srv2123538469:84 , srv318022672:84 , srv32743096:84 , srv376002492:84 , srv406731853:84 , srv472073005:84 , srv50654223:84 , srv528734041:84 , srv667780504:84 , srv673527239:84 , srv7102083:84 , srv736095073:84 , srv795768008:84 , srv851479784:84 , srv854838926:84 , srv910767632:84 , srv34103551:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-31 18:56:01,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:56:01,549 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486417201=3, srv34103551=16, srv736095073=25, srv1697246706=7, srv198673701=11, srv1570151925=5, srv1746473705=8, srv1204262588=1, srv1852852537=9, srv2123538469=13, srv854838926=28, srv1877550969=10, srv851479784=27, srv376002492=17, srv667780504=22, srv673527239=23, srv472073005=19, srv7102083=24, srv1289079462=2, srv406731853=18, srv1073770020=0, srv1502154246=4, srv32743096=15, srv910767632=29, srv795768008=26, srv528734041=21, srv1597165578=6, srv318022672=14, srv50654223=20, srv2062610252=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:56:01,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:56:01,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:56:01,565 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:56:01,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:56:01,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:56:01,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:56:01,566 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-31 18:56:01,595 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1172810484764808, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:56:01,595 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.991256259201845, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1172810484764808, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-31 18:58:01,570 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6202873 different iterations.  Found a solution that moves 1857 regions; Going from a computed imbalance of 0.991256259201845 to a new imbalance of 4.334330639506329E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6877777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:58:01,579 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073770020:90 , srv1204262588:90 , srv1289079462:90 , srv1486417201:90 , srv1502154246:90 , srv1570151925:90 , srv1597165578:90 , srv1697246706:90 , srv1746473705:90 , srv1852852537:90 , srv1877550969:90 , srv198673701:90 , srv2062610252:90 , srv2123538469:90 , srv318022672:90 , srv32743096:90 , srv34103551:90 , srv376002492:90 , srv406731853:90 , srv472073005:90 , srv50654223:90 , srv528734041:90 , srv667780504:90 , srv673527239:90 , srv7102083:90 , srv736095073:90 , srv795768008:90 , srv851479784:90 , srv854838926:90 , srv910767632:90 }
2023-03-31 18:58:01,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-31 18:58:01,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1486417201=3, srv34103551=16, srv736095073=25, srv1697246706=7, srv198673701=11, srv1570151925=5, srv1746473705=8, srv1204262588=1, srv1852852537=9, srv2123538469=13, srv854838926=28, srv1877550969=10, srv851479784=27, srv376002492=17, srv667780504=22, srv673527239=23, srv472073005=19, srv7102083=24, srv1289079462=2, srv406731853=18, srv1073770020=0, srv1502154246=4, srv32743096=15, srv910767632=29, srv795768008=26, srv528734041=21, srv1597165578=6, srv318022672=14, srv50654223=20, srv2062610252=12} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-31 18:58:01,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-31 18:58:01,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-31 18:58:01,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-31 18:58:01,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-31 18:58:01,602 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-31 18:58:01,603 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1073770020:90 , srv1204262588:90 , srv1289079462:90 , srv1486417201:90 , srv1502154246:90 , srv1570151925:90 , srv1597165578:90 , srv1697246706:90 , srv1746473705:90 , srv1852852537:90 , srv1877550969:90 , srv198673701:90 , srv2062610252:90 , srv2123538469:90 , srv318022672:90 , srv32743096:90 , srv34103551:90 , srv376002492:90 , srv406731853:90 , srv472073005:90 , srv50654223:90 , srv528734041:90 , srv667780504:90 , srv673527239:90 , srv7102083:90 , srv736095073:90 , srv795768008:90 , srv851479784:90 , srv854838926:90 , srv910767632:90 }
2023-03-31 18:58:01,616 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 343), ProcessCount=169 (was 169), AvailableMemoryMB=3869 (was 3821) - AvailableMemoryMB LEAK? -