2023-06-03 21:53:27,026 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-06-03 21:53:27,309 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-06-03 21:53:27,411 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-06-03 21:53:27,471 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-03 21:53:27,478 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-03 21:53:27,491 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=173, AvailableMemoryMB=2661
2023-06-03 21:53:27,492 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-03 21:53:27,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-06-03 21:53:27,618 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003830359:84 , srv1007812990:84 , srv1029654832:84 , srv1066447482:84 , srv1076782161:84 , srv1113996132:84 , srv1140772790:84 , srv1156638842:84 , srv115947579:84 , srv1238984494:84 , srv1261301159:84 , srv1262755878:84 , srv1306414510:84 , srv1314798835:84 , srv1314974114:84 , srv1385945263:84 , srv1419300104:84 , srv1463097328:84 , srv1539608189:84 , srv156872532:84 , srv1586130592:84 , srv1605870619:84 , srv1612048478:84 , srv1619503654:84 , srv162537454:84 , srv1630640314:84 , srv1638361370:84 , srv164534093:84 , srv1653035219:84 , srv1676299298:84 , srv1678216748:84 , srv1679793579:84 , srv1696910046:84 , srv1705698103:84 , srv172190838:84 , srv1737344486:84 , srv1757760910:84 , srv1781590265:84 , srv178758486:84 , srv1794688715:84 , srv179685036:84 , srv1849580840:84 , srv1855052306:84 , srv1870253253:84 , srv1900695229:84 , srv190203337:84 , srv1906861380:84 , srv1917566651:84 , srv1919929627:84 , srv1932756966:84 , srv1947799252:84 , srv1969473031:84 , srv1983889095:84 , srv198984942:84 , srv201644556:84 , srv2033053480:84 , srv2034808572:84 , srv2046164032:84 , srv2106772915:84 , srv2118559080:84 , srv213474442:84 , srv221809393:84 , srv240677823:84 , srv246482470:84 , srv29239736:84 , srv312153256:84 , srv343140436:84 , srv347533833:84 , srv35301884:84 , srv403722225:84 , srv417224091:84 , srv451157454:84 , srv453759069:84 , srv49279753:84 , srv53243723:84 , srv545276042:84 , srv54593506:84 , srv565412622:84 , srv56780722:84 , srv634625796:84 , srv65862025:84 , srv664711013:84 , srv668105964:84 , srv702171578:84 , srv715695773:84 , srv729090041:84 , srv731253359:84 , srv744398182:84 , srv748759130:84 , srv777649518:84 , srv817706964:84 , srv843292907:84 , srv901718793:84 , srv902302181:84 , srv909061226:84 , srv934739881:84 , srv936712200:84 , srv947120283:84 , srv999497916:84 , srv1965598713:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-06-03 21:53:27,626 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:27,632 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:27,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:27,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:27,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:27,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:27,690 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:27,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:27,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:27,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:27,694 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:27,695 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:27,696 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:27,697 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:27,698 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:27,699 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:27,931 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:27,931 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-03 21:53:27,931 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-03 21:53:28,304 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 573 ms to try 5000 different iterations.  Found a solution that moves 4664 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.18770193290428305. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929513639253265, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059434295366974775, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5182222222222223, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929513639253265, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18283333333333332, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25116666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:28,320 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1586130592:82 , srv172190838:82 , srv1983889095:82 , srv545276042:82 , srv702171578:82 , srv947120283:82 , srv1029654832:83 , srv1066447482:83 , srv1870253253:83 , srv1932756966:83 , srv2046164032:83 , srv49279753:83 , srv54593506:83 , srv901718793:83 , srv936712200:83 , srv1003830359:84 , srv1007812990:84 , srv1678216748:84 , srv1696910046:84 , srv1794688715:84 , srv221809393:84 , srv29239736:84 , srv417224091:84 , srv729090041:84 , srv1076782161:85 , srv1261301159:85 , srv1605870619:85 , srv1612048478:85 , srv164534093:85 , srv1781590265:85 , srv178758486:85 , srv1969473031:85 , srv198984942:85 , srv2034808572:85 , srv246482470:85 , srv347533833:85 , srv715695773:85 , srv777649518:85 , srv817706964:85 , srv843292907:85 , srv909061226:85 , srv1140772790:86 , srv115947579:86 , srv1306414510:86 , srv1539608189:86 , srv162537454:86 , srv179685036:86 , srv1855052306:86 , srv1919929627:86 , srv1947799252:86 , srv35301884:86 , srv634625796:86 , srv902302181:86 , srv1238984494:87 , srv1314798835:87 , srv156872532:87 , srv1619503654:87 , srv1653035219:87 , srv1757760910:87 , srv190203337:87 , srv201644556:87 , srv2033053480:87 , srv312153256:87 , srv403722225:87 , srv65862025:87 , srv664711013:87 , srv744398182:87 , srv748759130:87 , srv934739881:87 , srv1385945263:88 , srv1419300104:88 , srv1463097328:88 , srv1630640314:88 , srv1679793579:88 , srv1849580840:88 , srv2106772915:88 , srv240677823:88 , srv451157454:88 , srv1156638842:89 , srv1314974114:89 , srv1638361370:89 , srv1705698103:89 , srv1917566651:89 , srv343140436:89 , srv668105964:89 , srv1262755878:90 , srv1676299298:90 , srv565412622:90 , srv1113996132:91 , srv1737344486:91 , srv1906861380:91 , srv2118559080:91 , srv213474442:91 , srv53243723:91 , srv1900695229:92 , srv56780722:92 , srv453759069:93 , srv731253359:93 , srv999497916:96 , srv1965598713:439 }
2023-06-03 21:53:28,327 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:28,328 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:28,352 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:28,353 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:28,354 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:28,355 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:28,356 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:28,357 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:28,358 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:28,359 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:28,360 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:28,361 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:28,362 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:28,363 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:28,364 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:28,365 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:28,621 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929513639253265, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059434295366974775, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929513639253265, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18283333333333332, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25116666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:28,621 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-03 21:53:28,621 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18766927487826907, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03929513639253265, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.059434295366974775, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03929513639253265, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.18283333333333332, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.25116666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-03 21:53:28,977 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 592 ms to try 5000 different iterations.  Found a solution that moves 2719 regions; Going from a computed imbalance of 0.18766927487826907 to a new imbalance of 0.016411709855393957. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020034264201923734); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035260772963574924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.3021111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020034264201923734); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:28,991 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv999497916:76 , srv1900695229:79 , srv213474442:79 , srv453759069:79 , srv56780722:79 , srv1737344486:80 , srv731253359:80 , srv1314974114:81 , srv1113996132:82 , srv1638361370:82 , srv1906861380:82 , srv2118559080:82 , srv565412622:82 , srv1156638842:83 , srv1262755878:83 , srv1849580840:83 , srv2106772915:83 , srv53243723:83 , srv668105964:83 , srv748759130:83 , srv1238984494:84 , srv1385945263:84 , srv1419300104:84 , srv1463097328:84 , srv156872532:84 , srv1619503654:84 , srv162537454:84 , srv1630640314:84 , srv1679793579:84 , srv1917566651:84 , srv240677823:84 , srv343140436:84 , srv451157454:84 , srv934739881:84 , srv1314798835:85 , srv1653035219:85 , srv1705698103:85 , srv179685036:85 , srv201644556:85 , srv2033053480:85 , srv312153256:85 , srv634625796:85 , srv664711013:85 , srv744398182:85 , srv902302181:85 , srv1003830359:86 , srv1007812990:86 , srv1306414510:86 , srv1539608189:86 , srv1757760910:86 , srv1794688715:86 , srv1855052306:86 , srv190203337:86 , srv1947799252:86 , srv246482470:86 , srv347533833:86 , srv35301884:86 , srv65862025:86 , srv843292907:86 , srv1140772790:87 , srv1605870619:87 , srv1612048478:87 , srv164534093:87 , srv1676299298:87 , srv1781590265:87 , srv178758486:87 , srv1919929627:87 , srv198984942:87 , srv2034808572:87 , srv29239736:87 , srv54593506:87 , srv909061226:87 , srv1066447482:88 , srv1076782161:88 , srv115947579:88 , srv1261301159:88 , srv1969473031:88 , srv2046164032:88 , srv403722225:88 , srv817706964:88 , srv936712200:88 , srv172190838:89 , srv417224091:89 , srv777649518:89 , srv901718793:89 , srv1696910046:90 , srv1870253253:90 , srv1932756966:90 , srv1983889095:90 , srv221809393:90 , srv545276042:90 , srv702171578:90 , srv715695773:90 , srv947120283:90 , srv1678216748:91 , srv729090041:91 , srv1586130592:92 , srv49279753:92 , srv1029654832:93 , srv1965598713:513 }
2023-06-03 21:53:28,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:28,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:29,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:29,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:29,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:29,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:29,019 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:29,020 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:29,021 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:29,022 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:29,023 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:29,024 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:29,025 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:29,026 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:29,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020034264201923734); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035260772963574924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020034264201923734); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:29,189 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-03 21:53:29,189 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.016392671010468565, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020034264201923734); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.035260772963574924, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020034264201923734); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013083333333333334); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04841666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-03 21:53:29,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 452 ms to try 5000 different iterations.  Found a solution that moves 1031 regions; Going from a computed imbalance of 0.016392671010468565 to a new imbalance of 6.313582307592675E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008192411149895601); MoveCostFunction : (multiplier=7.0, imbalance=0.11455555555555555, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:29,495 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1676299298:81 , srv1029654832:82 , srv1678216748:82 , srv115947579:83 , srv1586130592:83 , srv1705698103:83 , srv1757760910:83 , srv403722225:83 , srv49279753:83 , srv715695773:83 , srv729090041:83 , srv777649518:83 , srv1113996132:84 , srv1140772790:84 , srv1262755878:84 , srv1696910046:84 , srv1917566651:84 , srv1969473031:84 , srv221809393:84 , srv417224091:84 , srv53243723:84 , srv65862025:84 , srv731253359:84 , srv1261301159:85 , srv1306414510:85 , srv1314798835:85 , srv1385945263:85 , srv1419300104:85 , srv1463097328:85 , srv1539608189:85 , srv1605870619:85 , srv1630640314:85 , srv164534093:85 , srv1679793579:85 , srv1781590265:85 , srv1855052306:85 , srv1870253253:85 , srv190203337:85 , srv1906861380:85 , srv1919929627:85 , srv201644556:85 , srv2118559080:85 , srv246482470:85 , srv312153256:85 , srv453759069:85 , srv668105964:85 , srv817706964:85 , srv909061226:85 , srv934739881:85 , srv1076782161:86 , srv1156638842:86 , srv156872532:86 , srv1612048478:86 , srv1619503654:86 , srv1638361370:86 , srv1653035219:86 , srv172190838:86 , srv1737344486:86 , srv1849580840:86 , srv1900695229:86 , srv1932756966:86 , srv1947799252:86 , srv1983889095:86 , srv198984942:86 , srv2033053480:86 , srv2034808572:86 , srv240677823:86 , srv29239736:86 , srv343140436:86 , srv35301884:86 , srv451157454:86 , srv545276042:86 , srv565412622:86 , srv56780722:86 , srv634625796:86 , srv664711013:86 , srv702171578:86 , srv843292907:86 , srv901718793:86 , srv902302181:86 , srv999497916:86 , srv1003830359:87 , srv1066447482:87 , srv1238984494:87 , srv1314974114:87 , srv162537454:87 , srv178758486:87 , srv179685036:87 , srv2046164032:87 , srv2106772915:87 , srv347533833:87 , srv54593506:87 , srv744398182:87 , srv936712200:87 , srv947120283:87 , srv1007812990:88 , srv1794688715:88 , srv213474442:88 , srv748759130:89 , srv1965598713:551 }
2023-06-03 21:53:29,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:29,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:29,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:29,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:29,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:29,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:29,512 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:29,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:29,514 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:29,515 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:29,516 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:29,517 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:29,621 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008192411149895601); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:29,622 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-03 21:53:29,622 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=6.241390144598635E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.005105203241514896); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008192411149895601); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.005105203241514896); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004583333333333333); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-03 21:53:29,982 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 455 ms to try 5000 different iterations.  Found a solution that moves 230 regions; Going from a computed imbalance of 6.241390144598635E-4 to a new imbalance of 3.5062035699529796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.025555555555555557, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:29,983 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1029654832:83 , srv1156638842:83 , srv178758486:83 , srv1794688715:83 , srv1932756966:83 , srv343140436:83 , srv744398182:83 , srv748759130:83 , srv947120283:83 , srv1007812990:84 , srv1066447482:84 , srv1076782161:84 , srv1238984494:84 , srv1306414510:84 , srv1463097328:84 , srv156872532:84 , srv1612048478:84 , srv1619503654:84 , srv1653035219:84 , srv1696910046:84 , srv179685036:84 , srv1870253253:84 , srv190203337:84 , srv1919929627:84 , srv1947799252:84 , srv198984942:84 , srv2034808572:84 , srv2046164032:84 , srv2106772915:84 , srv2118559080:84 , srv213474442:84 , srv221809393:84 , srv240677823:84 , srv347533833:84 , srv35301884:84 , srv403722225:84 , srv451157454:84 , srv49279753:84 , srv53243723:84 , srv545276042:84 , srv565412622:84 , srv664711013:84 , srv702171578:84 , srv729090041:84 , srv817706964:84 , srv901718793:84 , srv909061226:84 , srv936712200:84 , srv999497916:84 , srv1003830359:85 , srv1113996132:85 , srv1140772790:85 , srv115947579:85 , srv1261301159:85 , srv1262755878:85 , srv1314798835:85 , srv1314974114:85 , srv1385945263:85 , srv1419300104:85 , srv1539608189:85 , srv1586130592:85 , srv1605870619:85 , srv162537454:85 , srv1630640314:85 , srv1638361370:85 , srv164534093:85 , srv1676299298:85 , srv1678216748:85 , srv1679793579:85 , srv1705698103:85 , srv172190838:85 , srv1737344486:85 , srv1849580840:85 , srv1855052306:85 , srv1900695229:85 , srv1906861380:85 , srv1917566651:85 , srv1969473031:85 , srv1983889095:85 , srv201644556:85 , srv2033053480:85 , srv29239736:85 , srv312153256:85 , srv417224091:85 , srv453759069:85 , srv54593506:85 , srv56780722:85 , srv634625796:85 , srv65862025:85 , srv668105964:85 , srv715695773:85 , srv731253359:85 , srv777649518:85 , srv843292907:85 , srv902302181:85 , srv1757760910:86 , srv1781590265:86 , srv246482470:86 , srv934739881:86 , srv1965598713:639 }
2023-06-03 21:53:29,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:29,988 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:29,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:29,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:29,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:29,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:29,999 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:30,000 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:30,001 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:30,002 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:30,003 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:30,004 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:30,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:30,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:30,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:30,005 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:30,006 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:30,007 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:30,008 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:30,009 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:30,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:30,123 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-06-03 21:53:30,123 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.34515412777423E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.4668347344853864E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.4668347344853864E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-06-03 21:53:30,377 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 358 ms to try 5000 different iterations.  Found a solution that moves 26 regions; Going from a computed imbalance of 3.34515412777423E-5 to a new imbalance of 7.2552951874880335E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0028888888888888888); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:30,378 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1076782161:83 , srv1261301159:83 , srv1676299298:83 , srv1781590265:83 , srv1906861380:83 , srv1983889095:83 , srv2033053480:83 , srv715695773:83 , srv1003830359:84 , srv1007812990:84 , srv1066447482:84 , srv1113996132:84 , srv1140772790:84 , srv115947579:84 , srv1238984494:84 , srv1262755878:84 , srv1314798835:84 , srv1314974114:84 , srv1385945263:84 , srv1419300104:84 , srv1539608189:84 , srv1586130592:84 , srv1605870619:84 , srv1612048478:84 , srv162537454:84 , srv1630640314:84 , srv1638361370:84 , srv164534093:84 , srv1653035219:84 , srv1678216748:84 , srv1679793579:84 , srv1696910046:84 , srv1705698103:84 , srv172190838:84 , srv1737344486:84 , srv1757760910:84 , srv178758486:84 , srv179685036:84 , srv1849580840:84 , srv1855052306:84 , srv1870253253:84 , srv1900695229:84 , srv190203337:84 , srv1917566651:84 , srv1919929627:84 , srv1932756966:84 , srv1947799252:84 , srv1969473031:84 , srv198984942:84 , srv201644556:84 , srv2034808572:84 , srv2046164032:84 , srv2106772915:84 , srv2118559080:84 , srv213474442:84 , srv221809393:84 , srv240677823:84 , srv246482470:84 , srv29239736:84 , srv312153256:84 , srv343140436:84 , srv347533833:84 , srv35301884:84 , srv403722225:84 , srv417224091:84 , srv451157454:84 , srv453759069:84 , srv49279753:84 , srv53243723:84 , srv545276042:84 , srv54593506:84 , srv565412622:84 , srv56780722:84 , srv634625796:84 , srv65862025:84 , srv664711013:84 , srv668105964:84 , srv702171578:84 , srv729090041:84 , srv731253359:84 , srv744398182:84 , srv748759130:84 , srv777649518:84 , srv817706964:84 , srv843292907:84 , srv901718793:84 , srv902302181:84 , srv934739881:84 , srv936712200:84 , srv947120283:84 , srv999497916:84 , srv1029654832:85 , srv1156638842:85 , srv1306414510:85 , srv1463097328:85 , srv156872532:85 , srv1619503654:85 , srv1794688715:85 , srv909061226:85 , srv1965598713:684 }
2023-06-03 21:53:30,384 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:30,385 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1983889095=53, srv1947799252=50, srv190203337=45, srv213474442=61, srv2106772915=59, srv1855052306=42, srv1630640314=25, srv178758486=38, srv777649518=90, srv156872532=19, srv1586130592=20, srv343140436=67, srv1066447482=3, srv1539608189=18, srv1969473031=52, srv843292907=92, srv246482470=64, srv347533833=68, srv312153256=66, srv1156638842=7, srv1900695229=44, srv634625796=80, srv901718793=93, srv1794688715=39, srv1870253253=43, srv1932756966=49, srv744398182=88, srv1917566651=47, srv53243723=75, srv2033053480=56, srv565412622=78, srv668105964=83, srv1612048478=22, srv1238984494=9, srv1419300104=16, srv1737344486=35, srv1261301159=10, srv902302181=94, srv1781590265=37, srv35301884=69, srv1306414510=12, srv1965598713=51, srv1906861380=46, srv1919929627=48, srv664711013=82, srv1638361370=26, srv1113996132=5, srv1385945263=15, srv1007812990=1, srv2046164032=58, srv817706964=91, srv1314798835=13, srv1619503654=23, srv2118559080=60, srv172190838=34, srv115947579=8, srv403722225=70, srv936712200=97, srv1262755878=11, srv1605870619=21, srv1140772790=6, srv1003830359=0, srv1076782161=4, srv1653035219=28, srv451157454=72, srv65862025=81, srv731253359=87, srv240677823=63, srv29239736=65, srv417224091=71, srv909061226=95, srv201644556=55, srv729090041=86, srv164534093=27, srv1705698103=33, srv49279753=74, srv1849580840=41, srv198984942=54, srv1029654832=2, srv702171578=84, srv999497916=99, srv1463097328=17, srv162537454=24, srv545276042=76, srv2034808572=57, srv748759130=89, srv1676299298=29, srv715695773=85, srv1757760910=36, srv947120283=98, srv54593506=77, srv934739881=96, srv1314974114=14, srv56780722=79, srv221809393=62, srv453759069=73, srv1696910046=32, srv179685036=40, srv1678216748=30, srv1679793579=31} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:30,396 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-06-03 21:53:30,397 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-06-03 21:53:30,398 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-06-03 21:53:30,399 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-06-03 21:53:30,400 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-06-03 21:53:30,401 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-06-03 21:53:30,538 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=7.073239296329447E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0015713484026367722); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:30,538 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1076782161:83 , srv1261301159:83 , srv1676299298:83 , srv1781590265:83 , srv1906861380:83 , srv1983889095:83 , srv2033053480:83 , srv715695773:83 , srv1003830359:84 , srv1007812990:84 , srv1066447482:84 , srv1113996132:84 , srv1140772790:84 , srv115947579:84 , srv1238984494:84 , srv1262755878:84 , srv1314798835:84 , srv1314974114:84 , srv1385945263:84 , srv1419300104:84 , srv1539608189:84 , srv1586130592:84 , srv1605870619:84 , srv1612048478:84 , srv162537454:84 , srv1630640314:84 , srv1638361370:84 , srv164534093:84 , srv1653035219:84 , srv1678216748:84 , srv1679793579:84 , srv1696910046:84 , srv1705698103:84 , srv172190838:84 , srv1737344486:84 , srv1757760910:84 , srv178758486:84 , srv179685036:84 , srv1849580840:84 , srv1855052306:84 , srv1870253253:84 , srv1900695229:84 , srv190203337:84 , srv1917566651:84 , srv1919929627:84 , srv1932756966:84 , srv1947799252:84 , srv1969473031:84 , srv198984942:84 , srv201644556:84 , srv2034808572:84 , srv2046164032:84 , srv2106772915:84 , srv2118559080:84 , srv213474442:84 , srv221809393:84 , srv240677823:84 , srv246482470:84 , srv29239736:84 , srv312153256:84 , srv343140436:84 , srv347533833:84 , srv35301884:84 , srv403722225:84 , srv417224091:84 , srv451157454:84 , srv453759069:84 , srv49279753:84 , srv53243723:84 , srv545276042:84 , srv54593506:84 , srv565412622:84 , srv56780722:84 , srv634625796:84 , srv65862025:84 , srv664711013:84 , srv668105964:84 , srv702171578:84 , srv729090041:84 , srv731253359:84 , srv744398182:84 , srv748759130:84 , srv777649518:84 , srv817706964:84 , srv843292907:84 , srv901718793:84 , srv902302181:84 , srv934739881:84 , srv936712200:84 , srv947120283:84 , srv999497916:84 , srv1029654832:85 , srv1156638842:85 , srv1306414510:85 , srv1463097328:85 , srv156872532:85 , srv1619503654:85 , srv1794688715:85 , srv909061226:85 , srv1965598713:684 }
2023-06-03 21:53:30,570 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 297), ProcessCount=173 (was 173), AvailableMemoryMB=2157 (was 2661)
2023-06-03 21:53:30,578 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=173, AvailableMemoryMB=2156
2023-06-03 21:53:30,579 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-06-03 21:53:30,580 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-06-03 21:53:30,592 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1097540590:84 , srv1187697361:84 , srv1278381783:84 , srv138008886:84 , srv1540679599:84 , srv1546284576:84 , srv1576436725:84 , srv1728727472:84 , srv1741783116:84 , srv1797728889:84 , srv1890779898:84 , srv215865604:84 , srv284445929:84 , srv308933232:84 , srv371568681:84 , srv376125867:84 , srv377484449:84 , srv410426472:84 , srv502018650:84 , srv518947139:84 , srv545912536:84 , srv554988657:84 , srv566662787:84 , srv599583534:84 , srv671187508:84 , srv737475194:84 , srv923421500:84 , srv925527737:84 , srv95964792:84 , srv904670752:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-06-03 21:53:30,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:53:30,595 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1278381783=2, srv545912536=20, srv554988657=21, srv1741783116=8, srv138008886=3, srv1728727472=7, srv376125867=15, srv599583534=23, srv1576436725=6, srv566662787=22, srv95964792=29, srv410426472=17, srv1187697361=1, srv284445929=12, srv371568681=14, srv308933232=13, srv1540679599=4, srv737475194=25, srv1890779898=10, srv923421500=27, srv215865604=11, srv1797728889=9, srv377484449=16, srv1546284576=5, srv671187508=24, srv925527737=28, srv1097540590=0, srv904670752=26, srv502018650=18, srv518947139=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:53:30,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:53:30,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:53:30,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-03 21:53:30,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0805960351682244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:53:30,623 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912446998739393, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0805960351682244, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-06-03 21:55:30,611 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6029939 different iterations.  Found a solution that moves 1848 regions; Going from a computed imbalance of 0.9912446998739393 to a new imbalance of 4.313324190526491E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6844444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:55:30,617 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1097540590:90 , srv1187697361:90 , srv1278381783:90 , srv138008886:90 , srv1540679599:90 , srv1546284576:90 , srv1576436725:90 , srv1728727472:90 , srv1741783116:90 , srv1797728889:90 , srv1890779898:90 , srv215865604:90 , srv284445929:90 , srv308933232:90 , srv371568681:90 , srv376125867:90 , srv377484449:90 , srv410426472:90 , srv502018650:90 , srv518947139:90 , srv545912536:90 , srv554988657:90 , srv566662787:90 , srv599583534:90 , srv671187508:90 , srv737475194:90 , srv904670752:90 , srv923421500:90 , srv925527737:90 , srv95964792:90 }
2023-06-03 21:55:30,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-06-03 21:55:30,618 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1278381783=2, srv545912536=20, srv554988657=21, srv1741783116=8, srv138008886=3, srv1728727472=7, srv376125867=15, srv599583534=23, srv1576436725=6, srv566662787=22, srv95964792=29, srv410426472=17, srv1187697361=1, srv284445929=12, srv371568681=14, srv308933232=13, srv1540679599=4, srv737475194=25, srv1890779898=10, srv923421500=27, srv215865604=11, srv1797728889=9, srv377484449=16, srv1546284576=5, srv671187508=24, srv925527737=28, srv1097540590=0, srv904670752=26, srv502018650=18, srv518947139=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-06-03 21:55:30,621 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-06-03 21:55:30,622 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-06-03 21:55:30,623 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-06-03 21:55:30,634 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-06-03 21:55:30,634 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1097540590:90 , srv1187697361:90 , srv1278381783:90 , srv138008886:90 , srv1540679599:90 , srv1546284576:90 , srv1576436725:90 , srv1728727472:90 , srv1741783116:90 , srv1797728889:90 , srv1890779898:90 , srv215865604:90 , srv284445929:90 , srv308933232:90 , srv371568681:90 , srv376125867:90 , srv377484449:90 , srv410426472:90 , srv502018650:90 , srv518947139:90 , srv545912536:90 , srv554988657:90 , srv566662787:90 , srv599583534:90 , srv671187508:90 , srv737475194:90 , srv904670752:90 , srv923421500:90 , srv925527737:90 , srv95964792:90 }
2023-06-03 21:55:30,649 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 297), ProcessCount=173 (was 173), AvailableMemoryMB=1631 (was 2156)