2023-03-07 10:54:13,907 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-07 10:54:14,223 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-07 10:54:14,342 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-07 10:54:14,408 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-07 10:54:14,415 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-07 10:54:14,428 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=171, AvailableMemoryMB=10139
2023-03-07 10:54:14,430 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-07 10:54:14,430 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-07 10:54:14,546 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003368175:84 , srv1004486707:84 , srv1006695548:84 , srv1008168914:84 , srv1039686900:84 , srv1082355302:84 , srv1116877331:84 , srv1161718239:84 , srv1164829973:84 , srv1209665483:84 , srv125089936:84 , srv1343676992:84 , srv1379031575:84 , srv1384431845:84 , srv1423219321:84 , srv1443938333:84 , srv1478421093:84 , srv1543358342:84 , srv1547193953:84 , srv1551864300:84 , srv1602401401:84 , srv1612590421:84 , srv1626977636:84 , srv1631204739:84 , srv1638502878:84 , srv1653679575:84 , srv1667713983:84 , srv1684480794:84 , srv1689977421:84 , srv1715020231:84 , srv1730478353:84 , srv1751792366:84 , srv1785166072:84 , srv1789025332:84 , srv1791298216:84 , srv1844945:84 , srv1856899758:84 , srv186105643:84 , srv1877986149:84 , srv1897420395:84 , srv1919235857:84 , srv1921912367:84 , srv1961331343:84 , srv1974069957:84 , srv1998482286:84 , srv2001858214:84 , srv2010257174:84 , srv2026224529:84 , srv2029843709:84 , srv2050596619:84 , srv2057975863:84 , srv2095757773:84 , srv2120357219:84 , srv2126001469:84 , srv2126182291:84 , srv2127122314:84 , srv213143162:84 , srv245343660:84 , srv26377759:84 , srv274990512:84 , srv304658394:84 , srv309652161:84 , srv31267548:84 , srv33274125:84 , srv346649254:84 , srv364072567:84 , srv375157260:84 , srv391408685:84 , srv429951106:84 , srv475313566:84 , srv488237557:84 , srv490944810:84 , srv511389556:84 , srv544087754:84 , srv544469102:84 , srv559987891:84 , srv583569082:84 , srv58597924:84 , srv595765270:84 , srv608935770:84 , srv625121819:84 , srv680563576:84 , srv681035876:84 , srv682433959:84 , srv704429910:84 , srv706004514:84 , srv707294714:84 , srv722541123:84 , srv750026353:84 , srv779425839:84 , srv787703930:84 , srv804167526:84 , srv849254734:84 , srv890629666:84 , srv89977978:84 , srv900710046:84 , srv92228239:84 , srv961129589:84 , srv984071196:84 , srv1211181375:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-07 10:54:14,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:14,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv849254734=93, srv583569082=77, srv1343676992=12, srv58597924=78, srv2095757773=52, srv1998482286=45, srv1653679575=26, srv309652161=62, srv680563576=82, srv779425839=90, srv750026353=89, srv704429910=85, srv984071196=99, srv1006695548=2, srv1791298216=35, srv92228239=97, srv1602401401=21, srv475313566=70, srv1423219321=15, srv1612590421=22, srv274990512=60, srv1004486707=1, srv1897420395=40, srv1161718239=7, srv364072567=66, srv804167526=92, srv1443938333=16, srv2050596619=50, srv245343660=58, srv625121819=81, srv1211181375=10, srv1689977421=29, srv2057975863=51, srv1551864300=20, srv1667713983=27, srv1856899758=37, srv2010257174=47, srv544087754=74, srv722541123=88, srv1008168914=3, srv1961331343=43, srv1751792366=32, srv1789025332=34, srv2127122314=56, srv89977978=95, srv1631204739=24, srv1384431845=14, srv1638502878=25, srv1919235857=41, srv1974069957=44, srv1844945=36, srv26377759=59, srv681035876=83, srv429951106=69, srv1626977636=23, srv1116877331=6, srv2126182291=55, srv608935770=80, srv1785166072=33, srv890629666=94, srv213143162=57, srv961129589=98, srv706004514=86, srv595765270=79, srv1164829973=8, srv2029843709=49, srv31267548=63, srv1039686900=4, srv1209665483=9, srv33274125=64, srv900710046=96, srv2001858214=46, srv375157260=67, srv544469102=75, srv1379031575=13, srv2026224529=48, srv1715020231=30, srv186105643=38, srv1478421093=17, srv1082355302=5, srv2120357219=53, srv1730478353=31, srv346649254=65, srv490944810=72, srv488237557=71, srv1547193953=19, srv2126001469=54, srv559987891=76, srv707294714=87, srv1003368175=0, srv682433959=84, srv511389556=73, srv1877986149=39, srv1684480794=28, srv1543358342=18, srv787703930=91, srv391408685=68, srv125089936=11, srv304658394=61, srv1921912367=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:14,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:14,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:14,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-07 10:54:14,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-07 10:54:14,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-07 10:54:14,659 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-07 10:54:14,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-07 10:54:14,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-07 10:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-07 10:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-07 10:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-07 10:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-07 10:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-07 10:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-07 10:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-07 10:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-07 10:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-07 10:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-07 10:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-07 10:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-07 10:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-07 10:54:14,863 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:14,863 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-07 10:54:14,864 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-07 10:54:15,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 454 ms to try 5000 different iterations.  Found a solution that moves 4678 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18243878812184097. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041175821913631845, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05150485141631209, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5197777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041175821913631845, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:15,179 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv511389556:81 , srv625121819:82 , srv722541123:82 , srv900710046:82 , srv92228239:82 , srv1684480794:83 , srv213143162:83 , srv1003368175:84 , srv1039686900:84 , srv1443938333:84 , srv1478421093:84 , srv1543358342:84 , srv1877986149:84 , srv1998482286:84 , srv2010257174:84 , srv2095757773:84 , srv2126182291:84 , srv304658394:84 , srv364072567:84 , srv375157260:84 , srv681035876:84 , srv750026353:84 , srv787703930:84 , srv1006695548:85 , srv1161718239:85 , srv1343676992:85 , srv1551864300:85 , srv1689977421:85 , srv1751792366:85 , srv1791298216:85 , srv1844945:85 , srv1919235857:85 , srv1961331343:85 , srv309652161:85 , srv429951106:85 , srv608935770:85 , srv704429910:85 , srv707294714:85 , srv779425839:85 , srv849254734:85 , srv890629666:85 , srv961129589:85 , srv1004486707:86 , srv1008168914:86 , srv1116877331:86 , srv1209665483:86 , srv125089936:86 , srv1423219321:86 , srv1547193953:86 , srv1626977636:86 , srv1921912367:86 , srv1974069957:86 , srv2001858214:86 , srv2026224529:86 , srv2120357219:86 , srv31267548:86 , srv544469102:86 , srv583569082:86 , srv595765270:86 , srv1164829973:87 , srv1602401401:87 , srv1631204739:87 , srv1667713983:87 , srv1730478353:87 , srv1789025332:87 , srv1897420395:87 , srv2029843709:87 , srv2050596619:87 , srv2057975863:87 , srv274990512:87 , srv346649254:87 , srv544087754:87 , srv682433959:87 , srv804167526:87 , srv1379031575:88 , srv1653679575:88 , srv245343660:88 , srv33274125:88 , srv488237557:88 , srv58597924:88 , srv1082355302:89 , srv1785166072:89 , srv2126001469:89 , srv2127122314:89 , srv26377759:89 , srv490944810:89 , srv559987891:89 , srv680563576:89 , srv706004514:89 , srv984071196:89 , srv1612590421:90 , srv1638502878:90 , srv475313566:90 , srv1715020231:91 , srv1856899758:91 , srv391408685:91 , srv1384431845:92 , srv89977978:92 , srv186105643:98 , srv1211181375:456 }
2023-03-07 10:54:15,185 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:15,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv849254734=93, srv583569082=77, srv1343676992=12, srv58597924=78, srv2095757773=52, srv1998482286=45, srv1653679575=26, srv309652161=62, srv680563576=82, srv779425839=90, srv750026353=89, srv704429910=85, srv984071196=99, srv1006695548=2, srv1791298216=35, srv92228239=97, srv1602401401=21, srv475313566=70, srv1423219321=15, srv1612590421=22, srv274990512=60, srv1004486707=1, srv1897420395=40, srv1161718239=7, srv364072567=66, srv804167526=92, srv1443938333=16, srv2050596619=50, srv245343660=58, srv625121819=81, srv1211181375=10, srv1689977421=29, srv2057975863=51, srv1551864300=20, srv1667713983=27, srv1856899758=37, srv2010257174=47, srv544087754=74, srv722541123=88, srv1008168914=3, srv1961331343=43, srv1751792366=32, srv1789025332=34, srv2127122314=56, srv89977978=95, srv1631204739=24, srv1384431845=14, srv1638502878=25, srv1919235857=41, srv1974069957=44, srv1844945=36, srv26377759=59, srv681035876=83, srv429951106=69, srv1626977636=23, srv1116877331=6, srv2126182291=55, srv608935770=80, srv1785166072=33, srv890629666=94, srv213143162=57, srv961129589=98, srv706004514=86, srv595765270=79, srv1164829973=8, srv2029843709=49, srv31267548=63, srv1039686900=4, srv1209665483=9, srv33274125=64, srv900710046=96, srv2001858214=46, srv375157260=67, srv544469102=75, srv1379031575=13, srv2026224529=48, srv1715020231=30, srv186105643=38, srv1478421093=17, srv1082355302=5, srv2120357219=53, srv1730478353=31, srv346649254=65, srv490944810=72, srv488237557=71, srv1547193953=19, srv2126001469=54, srv559987891=76, srv707294714=87, srv1003368175=0, srv682433959=84, srv511389556=73, srv1877986149=39, srv1684480794=28, srv1543358342=18, srv787703930=91, srv391408685=68, srv125089936=11, srv304658394=61, srv1921912367=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:15,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:15,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:15,207 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:15,208 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:15,209 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:15,210 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-07 10:54:15,211 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-07 10:54:15,212 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-07 10:54:15,213 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-07 10:54:15,214 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-07 10:54:15,215 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-07 10:54:15,216 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-07 10:54:15,217 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-07 10:54:15,218 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-07 10:54:15,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-07 10:54:15,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-07 10:54:15,381 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041175821913631845, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05150485141631209, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041175821913631845, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:15,381 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-07 10:54:15,382 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18240603206573175, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.041175821913631845, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05150485141631209, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.041175821913631845, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17766666666666667, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24466666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-07 10:54:15,711 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 472 ms to try 5000 different iterations.  Found a solution that moves 2636 regions; Going from a computed imbalance of 0.18240603206573175 to a new imbalance of 0.013762786230777617. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022523214112595932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03259106210058205, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29288888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022523214112595932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:15,722 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv186105643:77 , srv89977978:78 , srv1638502878:80 , srv475313566:80 , srv490944810:80 , srv1082355302:81 , srv1384431845:81 , srv33274125:81 , srv1715020231:82 , srv1785166072:82 , srv391408685:82 , srv559987891:82 , srv680563576:82 , srv1379031575:83 , srv1612590421:83 , srv1730478353:83 , srv1921912367:83 , srv2029843709:83 , srv2127122314:83 , srv245343660:83 , srv26377759:83 , srv346649254:83 , srv58597924:83 , srv682433959:83 , srv706004514:83 , srv1008168914:84 , srv1164829973:84 , srv1209665483:84 , srv1547193953:84 , srv1551864300:84 , srv1653679575:84 , srv1856899758:84 , srv31267548:84 , srv488237557:84 , srv595765270:84 , srv804167526:84 , srv1004486707:85 , srv1161718239:85 , srv1343676992:85 , srv1602401401:85 , srv1667713983:85 , srv1897420395:85 , srv2001858214:85 , srv2126001469:85 , srv274990512:85 , srv309652161:85 , srv583569082:85 , srv779425839:85 , srv1006695548:86 , srv125089936:86 , srv1877986149:86 , srv1961331343:86 , srv2026224529:86 , srv2057975863:86 , srv2120357219:86 , srv544087754:86 , srv890629666:86 , srv984071196:86 , srv1423219321:87 , srv1543358342:87 , srv1631204739:87 , srv1751792366:87 , srv1789025332:87 , srv1919235857:87 , srv429951106:87 , srv544469102:87 , srv704429910:87 , srv849254734:87 , srv1116877331:88 , srv1684480794:88 , srv1689977421:88 , srv1791298216:88 , srv1844945:88 , srv1974069957:88 , srv2095757773:88 , srv2126182291:88 , srv304658394:88 , srv375157260:88 , srv608935770:88 , srv681035876:88 , srv1003368175:89 , srv1039686900:89 , srv1443938333:89 , srv1478421093:89 , srv1998482286:89 , srv2050596619:89 , srv364072567:89 , srv707294714:89 , srv722541123:89 , srv750026353:89 , srv961129589:89 , srv1626977636:90 , srv213143162:90 , srv511389556:90 , srv787703930:90 , srv2010257174:91 , srv625121819:91 , srv900710046:92 , srv92228239:95 , srv1211181375:518 }
2023-03-07 10:54:15,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:15,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv849254734=93, srv583569082=77, srv1343676992=12, srv58597924=78, srv2095757773=52, srv1998482286=45, srv1653679575=26, srv309652161=62, srv680563576=82, srv779425839=90, srv750026353=89, srv704429910=85, srv984071196=99, srv1006695548=2, srv1791298216=35, srv92228239=97, srv1602401401=21, srv475313566=70, srv1423219321=15, srv1612590421=22, srv274990512=60, srv1004486707=1, srv1897420395=40, srv1161718239=7, srv364072567=66, srv804167526=92, srv1443938333=16, srv2050596619=50, srv245343660=58, srv625121819=81, srv1211181375=10, srv1689977421=29, srv2057975863=51, srv1551864300=20, srv1667713983=27, srv1856899758=37, srv2010257174=47, srv544087754=74, srv722541123=88, srv1008168914=3, srv1961331343=43, srv1751792366=32, srv1789025332=34, srv2127122314=56, srv89977978=95, srv1631204739=24, srv1384431845=14, srv1638502878=25, srv1919235857=41, srv1974069957=44, srv1844945=36, srv26377759=59, srv681035876=83, srv429951106=69, srv1626977636=23, srv1116877331=6, srv2126182291=55, srv608935770=80, srv1785166072=33, srv890629666=94, srv213143162=57, srv961129589=98, srv706004514=86, srv595765270=79, srv1164829973=8, srv2029843709=49, srv31267548=63, srv1039686900=4, srv1209665483=9, srv33274125=64, srv900710046=96, srv2001858214=46, srv375157260=67, srv544469102=75, srv1379031575=13, srv2026224529=48, srv1715020231=30, srv186105643=38, srv1478421093=17, srv1082355302=5, srv2120357219=53, srv1730478353=31, srv346649254=65, srv490944810=72, srv488237557=71, srv1547193953=19, srv2126001469=54, srv559987891=76, srv707294714=87, srv1003368175=0, srv682433959=84, srv511389556=73, srv1877986149=39, srv1684480794=28, srv1543358342=18, srv787703930=91, srv391408685=68, srv125089936=11, srv304658394=61, srv1921912367=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:15,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:15,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-07 10:54:15,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-07 10:54:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-07 10:54:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-07 10:54:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-07 10:54:15,754 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-07 10:54:15,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-07 10:54:15,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-07 10:54:15,757 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-07 10:54:15,758 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-07 10:54:15,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022523214112595932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03259106210058205, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022523214112595932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:15,871 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-07 10:54:15,871 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013744328564274, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.022523214112595932); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03259106210058205, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.022523214112595932); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010416666666666666); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04566666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-07 10:54:16,139 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 365 ms to try 5000 different iterations.  Found a solution that moves 973 regions; Going from a computed imbalance of 0.013744328564274 to a new imbalance of 8.455597442693859E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005549941046232873); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.10811111111111112, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005549941046232873); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.006166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:16,142 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv92228239:80 , srv1626977636:81 , srv2050596619:81 , srv1856899758:82 , srv186105643:82 , srv1631204739:83 , srv1974069957:83 , srv2010257174:83 , srv2126001469:83 , srv900710046:83 , srv984071196:83 , srv1039686900:84 , srv1116877331:84 , srv1423219321:84 , srv1478421093:84 , srv1789025332:84 , srv1919235857:84 , srv2057975863:84 , srv364072567:84 , srv391408685:84 , srv625121819:84 , srv707294714:84 , srv750026353:84 , srv787703930:84 , srv1003368175:85 , srv1004486707:85 , srv1384431845:85 , srv1443938333:85 , srv1602401401:85 , srv1612590421:85 , srv1689977421:85 , srv1715020231:85 , srv1751792366:85 , srv1791298216:85 , srv1844945:85 , srv1897420395:85 , srv1998482286:85 , srv2127122314:85 , srv213143162:85 , srv304658394:85 , srv511389556:85 , srv544087754:85 , srv608935770:85 , srv681035876:85 , srv704429910:85 , srv849254734:85 , srv961129589:85 , srv1006695548:86 , srv1164829973:86 , srv125089936:86 , srv1379031575:86 , srv1653679575:86 , srv1667713983:86 , srv1684480794:86 , srv1785166072:86 , srv2001858214:86 , srv2026224529:86 , srv2095757773:86 , srv2120357219:86 , srv2126182291:86 , srv274990512:86 , srv375157260:86 , srv429951106:86 , srv544469102:86 , srv583569082:86 , srv58597924:86 , srv680563576:86 , srv706004514:86 , srv722541123:86 , srv779425839:86 , srv1008168914:87 , srv1082355302:87 , srv1209665483:87 , srv1543358342:87 , srv1638502878:87 , srv1877986149:87 , srv1961331343:87 , srv245343660:87 , srv26377759:87 , srv346649254:87 , srv475313566:87 , srv488237557:87 , srv559987891:87 , srv804167526:87 , srv890629666:87 , srv89977978:87 , srv1161718239:88 , srv1343676992:88 , srv1547193953:88 , srv1551864300:88 , srv1921912367:88 , srv2029843709:88 , srv309652161:88 , srv33274125:88 , srv490944810:88 , srv595765270:88 , srv682433959:88 , srv1730478353:89 , srv31267548:89 , srv1211181375:533 }
2023-03-07 10:54:16,145 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:16,146 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv849254734=93, srv583569082=77, srv1343676992=12, srv58597924=78, srv2095757773=52, srv1998482286=45, srv1653679575=26, srv309652161=62, srv680563576=82, srv779425839=90, srv750026353=89, srv704429910=85, srv984071196=99, srv1006695548=2, srv1791298216=35, srv92228239=97, srv1602401401=21, srv475313566=70, srv1423219321=15, srv1612590421=22, srv274990512=60, srv1004486707=1, srv1897420395=40, srv1161718239=7, srv364072567=66, srv804167526=92, srv1443938333=16, srv2050596619=50, srv245343660=58, srv625121819=81, srv1211181375=10, srv1689977421=29, srv2057975863=51, srv1551864300=20, srv1667713983=27, srv1856899758=37, srv2010257174=47, srv544087754=74, srv722541123=88, srv1008168914=3, srv1961331343=43, srv1751792366=32, srv1789025332=34, srv2127122314=56, srv89977978=95, srv1631204739=24, srv1384431845=14, srv1638502878=25, srv1919235857=41, srv1974069957=44, srv1844945=36, srv26377759=59, srv681035876=83, srv429951106=69, srv1626977636=23, srv1116877331=6, srv2126182291=55, srv608935770=80, srv1785166072=33, srv890629666=94, srv213143162=57, srv961129589=98, srv706004514=86, srv595765270=79, srv1164829973=8, srv2029843709=49, srv31267548=63, srv1039686900=4, srv1209665483=9, srv33274125=64, srv900710046=96, srv2001858214=46, srv375157260=67, srv544469102=75, srv1379031575=13, srv2026224529=48, srv1715020231=30, srv186105643=38, srv1478421093=17, srv1082355302=5, srv2120357219=53, srv1730478353=31, srv346649254=65, srv490944810=72, srv488237557=71, srv1547193953=19, srv2126001469=54, srv559987891=76, srv707294714=87, srv1003368175=0, srv682433959=84, srv511389556=73, srv1877986149=39, srv1684480794=28, srv1543358342=18, srv787703930=91, srv391408685=68, srv125089936=11, srv304658394=61, srv1921912367=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:16,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:16,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:16,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:16,156 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:16,157 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-07 10:54:16,158 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-07 10:54:16,159 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-07 10:54:16,160 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-07 10:54:16,161 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-07 10:54:16,162 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-07 10:54:16,273 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005549941046232873); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005549941046232873); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.006166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:16,274 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-07 10:54:16,274 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.387466526502587E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005549941046232873); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00705915362006309); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005549941046232873); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=2.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.006166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-07 10:54:16,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 464 ms to try 5000 different iterations.  Found a solution that moves 273 regions; Going from a computed imbalance of 8.387466526502587E-4 to a new imbalance of 1.1581292580587233E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.030333333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:16,637 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv961129589:82 , srv1161718239:83 , srv1730478353:83 , srv26377759:83 , srv309652161:83 , srv31267548:83 , srv488237557:83 , srv544469102:83 , srv706004514:83 , srv1003368175:84 , srv1116877331:84 , srv125089936:84 , srv1343676992:84 , srv1384431845:84 , srv1443938333:84 , srv1543358342:84 , srv1547193953:84 , srv1612590421:84 , srv1653679575:84 , srv1667713983:84 , srv1689977421:84 , srv1715020231:84 , srv1789025332:84 , srv1791298216:84 , srv1844945:84 , srv1921912367:84 , srv1998482286:84 , srv2010257174:84 , srv2026224529:84 , srv2029843709:84 , srv2095757773:84 , srv2126001469:84 , srv213143162:84 , srv245343660:84 , srv274990512:84 , srv304658394:84 , srv364072567:84 , srv375157260:84 , srv429951106:84 , srv475313566:84 , srv544087754:84 , srv559987891:84 , srv595765270:84 , srv608935770:84 , srv682433959:84 , srv707294714:84 , srv787703930:84 , srv804167526:84 , srv890629666:84 , srv1006695548:85 , srv1008168914:85 , srv1082355302:85 , srv1164829973:85 , srv1209665483:85 , srv1379031575:85 , srv1423219321:85 , srv1478421093:85 , srv1551864300:85 , srv1602401401:85 , srv1626977636:85 , srv1631204739:85 , srv1638502878:85 , srv1684480794:85 , srv1751792366:85 , srv1785166072:85 , srv1856899758:85 , srv186105643:85 , srv1877986149:85 , srv1897420395:85 , srv1961331343:85 , srv1974069957:85 , srv2001858214:85 , srv2050596619:85 , srv2057975863:85 , srv2120357219:85 , srv2126182291:85 , srv33274125:85 , srv346649254:85 , srv391408685:85 , srv490944810:85 , srv583569082:85 , srv58597924:85 , srv625121819:85 , srv680563576:85 , srv681035876:85 , srv704429910:85 , srv722541123:85 , srv750026353:85 , srv849254734:85 , srv900710046:85 , srv92228239:85 , srv984071196:85 , srv1039686900:86 , srv1919235857:86 , srv2127122314:86 , srv511389556:86 , srv779425839:86 , srv89977978:86 , srv1004486707:87 , srv1211181375:636 }
2023-03-07 10:54:16,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:16,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv849254734=93, srv583569082=77, srv1343676992=12, srv58597924=78, srv2095757773=52, srv1998482286=45, srv1653679575=26, srv309652161=62, srv680563576=82, srv779425839=90, srv750026353=89, srv704429910=85, srv984071196=99, srv1006695548=2, srv1791298216=35, srv92228239=97, srv1602401401=21, srv475313566=70, srv1423219321=15, srv1612590421=22, srv274990512=60, srv1004486707=1, srv1897420395=40, srv1161718239=7, srv364072567=66, srv804167526=92, srv1443938333=16, srv2050596619=50, srv245343660=58, srv625121819=81, srv1211181375=10, srv1689977421=29, srv2057975863=51, srv1551864300=20, srv1667713983=27, srv1856899758=37, srv2010257174=47, srv544087754=74, srv722541123=88, srv1008168914=3, srv1961331343=43, srv1751792366=32, srv1789025332=34, srv2127122314=56, srv89977978=95, srv1631204739=24, srv1384431845=14, srv1638502878=25, srv1919235857=41, srv1974069957=44, srv1844945=36, srv26377759=59, srv681035876=83, srv429951106=69, srv1626977636=23, srv1116877331=6, srv2126182291=55, srv608935770=80, srv1785166072=33, srv890629666=94, srv213143162=57, srv961129589=98, srv706004514=86, srv595765270=79, srv1164829973=8, srv2029843709=49, srv31267548=63, srv1039686900=4, srv1209665483=9, srv33274125=64, srv900710046=96, srv2001858214=46, srv375157260=67, srv544469102=75, srv1379031575=13, srv2026224529=48, srv1715020231=30, srv186105643=38, srv1478421093=17, srv1082355302=5, srv2120357219=53, srv1730478353=31, srv346649254=65, srv490944810=72, srv488237557=71, srv1547193953=19, srv2126001469=54, srv559987891=76, srv707294714=87, srv1003368175=0, srv682433959=84, srv511389556=73, srv1877986149=39, srv1684480794=28, srv1543358342=18, srv787703930=91, srv391408685=68, srv125089936=11, srv304658394=61, srv1921912367=42} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:16,652 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:16,653 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-07 10:54:16,654 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-07 10:54:16,655 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-07 10:54:16,656 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-07 10:54:16,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-07 10:54:16,658 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-07 10:54:16,790 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=9.669705723422084E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:16,790 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv961129589:82 , srv1161718239:83 , srv1730478353:83 , srv26377759:83 , srv309652161:83 , srv31267548:83 , srv488237557:83 , srv544469102:83 , srv706004514:83 , srv1003368175:84 , srv1116877331:84 , srv125089936:84 , srv1343676992:84 , srv1384431845:84 , srv1443938333:84 , srv1543358342:84 , srv1547193953:84 , srv1612590421:84 , srv1653679575:84 , srv1667713983:84 , srv1689977421:84 , srv1715020231:84 , srv1789025332:84 , srv1791298216:84 , srv1844945:84 , srv1921912367:84 , srv1998482286:84 , srv2010257174:84 , srv2026224529:84 , srv2029843709:84 , srv2095757773:84 , srv2126001469:84 , srv213143162:84 , srv245343660:84 , srv274990512:84 , srv304658394:84 , srv364072567:84 , srv375157260:84 , srv429951106:84 , srv475313566:84 , srv544087754:84 , srv559987891:84 , srv595765270:84 , srv608935770:84 , srv682433959:84 , srv707294714:84 , srv787703930:84 , srv804167526:84 , srv890629666:84 , srv1006695548:85 , srv1008168914:85 , srv1082355302:85 , srv1164829973:85 , srv1209665483:85 , srv1379031575:85 , srv1423219321:85 , srv1478421093:85 , srv1551864300:85 , srv1602401401:85 , srv1626977636:85 , srv1631204739:85 , srv1638502878:85 , srv1684480794:85 , srv1751792366:85 , srv1785166072:85 , srv1856899758:85 , srv186105643:85 , srv1877986149:85 , srv1897420395:85 , srv1961331343:85 , srv1974069957:85 , srv2001858214:85 , srv2050596619:85 , srv2057975863:85 , srv2120357219:85 , srv2126182291:85 , srv33274125:85 , srv346649254:85 , srv391408685:85 , srv490944810:85 , srv583569082:85 , srv58597924:85 , srv625121819:85 , srv680563576:85 , srv681035876:85 , srv704429910:85 , srv722541123:85 , srv750026353:85 , srv849254734:85 , srv900710046:85 , srv92228239:85 , srv984071196:85 , srv1039686900:86 , srv1919235857:86 , srv2127122314:86 , srv511389556:86 , srv779425839:86 , srv89977978:86 , srv1004486707:87 , srv1211181375:636 }
2023-03-07 10:54:16,818 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 274), ProcessCount=171 (was 171), AvailableMemoryMB=9602 (was 10139)
2023-03-07 10:54:16,827 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=171, AvailableMemoryMB=9602
2023-03-07 10:54:16,828 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-07 10:54:16,828 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-07 10:54:16,836 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1073097199:84 , srv1086374986:84 , srv1126323477:84 , srv1222585815:84 , srv1322379688:84 , srv134254494:84 , srv1417599265:84 , srv1434694934:84 , srv1448336842:84 , srv1466488106:84 , srv1512725114:84 , srv1595598326:84 , srv163056250:84 , srv1717480624:84 , srv1721934249:84 , srv1762928031:84 , srv183347690:84 , srv1836772650:84 , srv1894180084:84 , srv2143624841:84 , srv217721868:84 , srv231085314:84 , srv278362948:84 , srv311632233:84 , srv604103559:84 , srv642556972:84 , srv705205260:84 , srv743577574:84 , srv832109523:84 , srv792743893:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-07 10:54:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:54:16,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv642556972=25, srv1086374986=1, srv1894180084=18, srv792743893=28, srv604103559=24, srv1595598326=11, srv1836772650=17, srv311632233=23, srv1126323477=2, srv1466488106=9, srv163056250=12, srv1717480624=13, srv134254494=5, srv278362948=22, srv183347690=16, srv217721868=20, srv832109523=29, srv1073097199=0, srv1222585815=3, srv1448336842=8, srv2143624841=19, srv705205260=26, srv1721934249=14, srv231085314=21, srv743577574=27, srv1417599265=6, srv1762928031=15, srv1512725114=10, srv1322379688=4, srv1434694934=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:54:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:54:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:54:16,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:54:16,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:54:16,853 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-07 10:54:16,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0683293044572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:54:16,868 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912408346671469, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0683293044572, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-07 10:56:16,856 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5830242 different iterations.  Found a solution that moves 1849 regions; Going from a computed imbalance of 0.9912408346671469 to a new imbalance of 4.3156582404131396E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6848148148148148, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:56:16,862 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1073097199:90 , srv1086374986:90 , srv1126323477:90 , srv1222585815:90 , srv1322379688:90 , srv134254494:90 , srv1417599265:90 , srv1434694934:90 , srv1448336842:90 , srv1466488106:90 , srv1512725114:90 , srv1595598326:90 , srv163056250:90 , srv1717480624:90 , srv1721934249:90 , srv1762928031:90 , srv183347690:90 , srv1836772650:90 , srv1894180084:90 , srv2143624841:90 , srv217721868:90 , srv231085314:90 , srv278362948:90 , srv311632233:90 , srv604103559:90 , srv642556972:90 , srv705205260:90 , srv743577574:90 , srv792743893:90 , srv832109523:90 }
2023-03-07 10:56:16,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-07 10:56:16,863 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv642556972=25, srv1086374986=1, srv1894180084=18, srv792743893=28, srv604103559=24, srv1595598326=11, srv1836772650=17, srv311632233=23, srv1126323477=2, srv1466488106=9, srv163056250=12, srv1717480624=13, srv134254494=5, srv278362948=22, srv183347690=16, srv217721868=20, srv832109523=29, srv1073097199=0, srv1222585815=3, srv1448336842=8, srv2143624841=19, srv705205260=26, srv1721934249=14, srv231085314=21, srv743577574=27, srv1417599265=6, srv1762928031=15, srv1512725114=10, srv1322379688=4, srv1434694934=7} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-07 10:56:16,866 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-07 10:56:16,867 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-07 10:56:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-07 10:56:16,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-07 10:56:16,880 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-07 10:56:16,880 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1073097199:90 , srv1086374986:90 , srv1126323477:90 , srv1222585815:90 , srv1322379688:90 , srv134254494:90 , srv1417599265:90 , srv1434694934:90 , srv1448336842:90 , srv1466488106:90 , srv1512725114:90 , srv1595598326:90 , srv163056250:90 , srv1717480624:90 , srv1721934249:90 , srv1762928031:90 , srv183347690:90 , srv1836772650:90 , srv1894180084:90 , srv2143624841:90 , srv217721868:90 , srv231085314:90 , srv278362948:90 , srv311632233:90 , srv604103559:90 , srv642556972:90 , srv705205260:90 , srv743577574:90 , srv792743893:90 , srv832109523:90 }
2023-03-07 10:56:16,892 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 274), ProcessCount=171 (was 171), AvailableMemoryMB=9333 (was 9602)