2023-04-25 09:55:37,845 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-25 09:55:38,210 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-25 09:55:38,335 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-25 09:55:38,404 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 09:55:38,413 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 09:55:38,429 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=170, AvailableMemoryMB=4992
2023-04-25 09:55:38,432 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 09:55:38,432 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-25 09:55:38,574 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1000926970:84 , srv1014686014:84 , srv1020162557:84 , srv1025422806:84 , srv1038579382:84 , srv1038809920:84 , srv1041523118:84 , srv1056868636:84 , srv1063668519:84 , srv1074903945:84 , srv11039587:84 , srv1159897839:84 , srv1179127350:84 , srv1195356639:84 , srv1211885309:84 , srv1213998909:84 , srv1252943970:84 , srv1266044540:84 , srv1284216138:84 , srv1291313170:84 , srv1362946571:84 , srv1415428217:84 , srv1452663122:84 , srv1460435231:84 , srv1498116616:84 , srv1523044162:84 , srv1531796034:84 , srv1595387423:84 , srv1600890133:84 , srv1624041421:84 , srv1632106052:84 , srv1649901957:84 , srv1659423183:84 , srv1671280221:84 , srv1726298366:84 , srv1832014466:84 , srv1843743440:84 , srv1845812525:84 , srv1852123709:84 , srv1863957916:84 , srv1870114077:84 , srv18920076:84 , srv1942914433:84 , srv196043703:84 , srv1993706473:84 , srv2009602994:84 , srv2047716172:84 , srv2065134553:84 , srv2088551256:84 , srv2089184516:84 , srv2090790245:84 , srv2096174110:84 , srv2100904863:84 , srv2115026146:84 , srv2117666089:84 , srv2124729421:84 , srv228894383:84 , srv252553706:84 , srv259227499:84 , srv260990529:84 , srv273146857:84 , srv310010128:84 , srv321593813:84 , srv403335375:84 , srv407543872:84 , srv448260872:84 , srv462169730:84 , srv46871746:84 , srv497751954:84 , srv498436599:84 , srv528404917:84 , srv537780606:84 , srv541974042:84 , srv569100362:84 , srv580709561:84 , srv603974435:84 , srv619444640:84 , srv649074670:84 , srv654362220:84 , srv70973540:84 , srv721624542:84 , srv758658622:84 , srv765815564:84 , srv772516234:84 , srv780966982:84 , srv813918207:84 , srv818199638:84 , srv840515068:84 , srv845710872:84 , srv865422906:84 , srv872975944:84 , srv907708333:84 , srv916271226:84 , srv939895422:84 , srv942980964:84 , srv944967513:84 , srv946564686:84 , srv9531320:84 , srv964983343:84 , srv717597470:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-25 09:55:38,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:38,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1056868636=7, srv1659423183=32, srv2047716172=46, srv1000926970=0, srv939895422=94, srv1252943970=16, srv1074903945=9, srv2089184516=49, srv845710872=89, srv1038579382=4, srv1063668519=8, srv813918207=86, srv1942914433=42, srv1211885309=14, srv1531796034=26, srv448260872=65, srv1993706473=44, srv944967513=96, srv1415428217=21, srv1014686014=1, srv541974042=72, srv1452663122=22, srv2088551256=48, srv1852123709=38, srv2115026146=53, srv1843743440=36, srv780966982=85, srv11039587=10, srv1362946571=20, srv840515068=88, srv1291313170=19, srv259227499=58, srv403335375=63, srv46871746=67, srv1726298366=34, srv1649901957=31, srv1266044540=17, srv70973540=79, srv1041523118=6, srv2124729421=55, srv1671280221=33, srv537780606=71, srv1179127350=12, srv1845812525=37, srv2100904863=52, srv407543872=64, srv1498116616=24, srv1284216138=18, srv260990529=59, srv1523044162=25, srv603974435=75, srv2117666089=54, srv717597470=80, srv498436599=69, srv310010128=61, srv1195356639=13, srv1038809920=5, srv865422906=90, srv1213998909=15, srv1595387423=27, srv942980964=95, srv721624542=81, srv916271226=93, srv2096174110=51, srv964983343=99, srv1870114077=40, srv649074670=77, srv528404917=70, srv772516234=84, srv1159897839=11, srv654362220=78, srv619444640=76, srv497751954=68, srv818199638=87, srv1624041421=29, srv2090790245=50, srv765815564=83, srv1020162557=2, srv2065134553=47, srv196043703=43, srv872975944=91, srv946564686=97, srv273146857=60, srv1832014466=35, srv758658622=82, srv907708333=92, srv18920076=41, srv1025422806=3, srv321593813=62, srv228894383=56, srv252553706=57, srv1460435231=23, srv1863957916=39, srv1600890133=28, srv462169730=66, srv2009602994=45, srv580709561=74, srv569100362=73, srv9531320=98, srv1632106052=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:38,717 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:38,718 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:38,719 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:38,720 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:38,721 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 09:55:38,722 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 09:55:38,723 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 09:55:38,724 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 09:55:38,725 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 09:55:38,726 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 09:55:38,727 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 09:55:38,728 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 09:55:38,729 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 09:55:38,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:38,983 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 09:55:38,983 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 09:55:39,917 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1152 ms to try 5000 different iterations.  Found a solution that moves 4697 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1795627563121132. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03986603079719166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05728813503042098, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5218888888888888, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03986603079719166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23916666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:39,945 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv758658622:80 , srv942980964:80 , srv1266044540:82 , srv1852123709:82 , srv2115026146:82 , srv580709561:82 , srv654362220:82 , srv916271226:82 , srv1056868636:83 , srv1595387423:83 , srv1870114077:83 , srv321593813:83 , srv407543872:83 , srv528404917:83 , srv765815564:83 , srv818199638:83 , srv872975944:83 , srv946564686:83 , srv11039587:84 , srv1211885309:84 , srv1415428217:84 , srv1460435231:84 , srv1523044162:84 , srv2117666089:84 , srv260990529:84 , srv569100362:84 , srv780966982:84 , srv964983343:84 , srv1038579382:85 , srv1159897839:85 , srv1195356639:85 , srv1531796034:85 , srv1649901957:85 , srv2065134553:85 , srv2088551256:85 , srv2124729421:85 , srv273146857:85 , srv1020162557:86 , srv1074903945:86 , srv1284216138:86 , srv1362946571:86 , srv1832014466:86 , srv1845812525:86 , srv196043703:86 , srv2090790245:86 , srv2096174110:86 , srv310010128:86 , srv403335375:86 , srv462169730:86 , srv541974042:86 , srv70973540:86 , srv813918207:86 , srv845710872:86 , srv865422906:86 , srv939895422:86 , srv944967513:86 , srv1025422806:87 , srv1452663122:87 , srv1600890133:87 , srv1863957916:87 , srv721624542:87 , srv1624041421:88 , srv1632106052:88 , srv1726298366:88 , srv2047716172:88 , srv497751954:88 , srv619444640:88 , srv772516234:88 , srv907708333:88 , srv1014686014:89 , srv1038809920:89 , srv1041523118:89 , srv1252943970:89 , srv1291313170:89 , srv1843743440:89 , srv18920076:89 , srv1942914433:89 , srv2009602994:89 , srv2100904863:89 , srv228894383:89 , srv252553706:89 , srv259227499:89 , srv448260872:89 , srv46871746:89 , srv498436599:89 , srv537780606:89 , srv603974435:89 , srv9531320:89 , srv1063668519:90 , srv1213998909:90 , srv1659423183:90 , srv1671280221:90 , srv2089184516:90 , srv649074670:90 , srv840515068:90 , srv1498116616:92 , srv1179127350:93 , srv1993706473:93 , srv1000926970:97 , srv717597470:444 }
2023-04-25 09:55:39,952 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:39,954 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1056868636=7, srv1659423183=32, srv2047716172=46, srv1000926970=0, srv939895422=94, srv1252943970=16, srv1074903945=9, srv2089184516=49, srv845710872=89, srv1038579382=4, srv1063668519=8, srv813918207=86, srv1942914433=42, srv1211885309=14, srv1531796034=26, srv448260872=65, srv1993706473=44, srv944967513=96, srv1415428217=21, srv1014686014=1, srv541974042=72, srv1452663122=22, srv2088551256=48, srv1852123709=38, srv2115026146=53, srv1843743440=36, srv780966982=85, srv11039587=10, srv1362946571=20, srv840515068=88, srv1291313170=19, srv259227499=58, srv403335375=63, srv46871746=67, srv1726298366=34, srv1649901957=31, srv1266044540=17, srv70973540=79, srv1041523118=6, srv2124729421=55, srv1671280221=33, srv537780606=71, srv1179127350=12, srv1845812525=37, srv2100904863=52, srv407543872=64, srv1498116616=24, srv1284216138=18, srv260990529=59, srv1523044162=25, srv603974435=75, srv2117666089=54, srv717597470=80, srv498436599=69, srv310010128=61, srv1195356639=13, srv1038809920=5, srv865422906=90, srv1213998909=15, srv1595387423=27, srv942980964=95, srv721624542=81, srv916271226=93, srv2096174110=51, srv964983343=99, srv1870114077=40, srv649074670=77, srv528404917=70, srv772516234=84, srv1159897839=11, srv654362220=78, srv619444640=76, srv497751954=68, srv818199638=87, srv1624041421=29, srv2090790245=50, srv765815564=83, srv1020162557=2, srv2065134553=47, srv196043703=43, srv872975944=91, srv946564686=97, srv273146857=60, srv1832014466=35, srv758658622=82, srv907708333=92, srv18920076=41, srv1025422806=3, srv321593813=62, srv228894383=56, srv252553706=57, srv1460435231=23, srv1863957916=39, srv1600890133=28, srv462169730=66, srv2009602994=45, srv580709561=74, srv569100362=73, srv9531320=98, srv1632106052=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:39,984 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:39,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:39,985 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:39,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:39,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:39,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:39,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:39,986 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:39,987 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:39,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:39,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:39,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:39,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:39,989 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:39,990 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 09:55:39,991 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 09:55:39,992 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 09:55:39,993 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 09:55:39,994 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 09:55:39,995 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 09:55:39,996 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 09:55:39,997 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 09:55:39,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 09:55:39,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 09:55:39,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 09:55:39,998 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 09:55:40,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03986603079719166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05728813503042098, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03986603079719166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23916666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:40,153 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 09:55:40,153 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17952986721516045, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03986603079719166, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05728813503042098, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03986603079719166, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.175, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23916666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 09:55:40,510 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 484 ms to try 5000 different iterations.  Found a solution that moves 2618 regions; Going from a computed imbalance of 0.17952986721516045 to a new imbalance of 0.014083741317306152. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02294449132156208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03513641844631533, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29088888888888886, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02294449132156208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:40,524 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1000926970:75 , srv1498116616:77 , srv1179127350:80 , srv1659423183:80 , srv1993706473:80 , srv2089184516:80 , srv1942914433:81 , srv840515068:81 , srv1014686014:82 , srv1038809920:82 , srv1041523118:82 , srv1063668519:82 , srv1213998909:82 , srv1252943970:82 , srv1291313170:82 , srv2100904863:82 , srv228894383:82 , srv907708333:82 , srv1671280221:83 , srv1843743440:83 , srv1845812525:83 , srv18920076:83 , srv2047716172:83 , srv252553706:83 , srv259227499:83 , srv497751954:83 , srv498436599:83 , srv649074670:83 , srv939895422:83 , srv9531320:83 , srv1452663122:84 , srv1600890133:84 , srv1632106052:84 , srv403335375:84 , srv448260872:84 , srv46871746:84 , srv537780606:84 , srv603974435:84 , srv619444640:84 , srv772516234:84 , srv865422906:84 , srv1020162557:85 , srv1159897839:85 , srv1284216138:85 , srv1362946571:85 , srv1531796034:85 , srv1624041421:85 , srv1726298366:85 , srv1863957916:85 , srv2088551256:85 , srv2090790245:85 , srv944967513:85 , srv1025422806:86 , srv1038579382:86 , srv1074903945:86 , srv196043703:86 , srv2124729421:86 , srv721624542:86 , srv813918207:86 , srv845710872:86 , srv1523044162:87 , srv2009602994:87 , srv462169730:87 , srv541974042:87 , srv70973540:87 , srv780966982:87 , srv964983343:87 , srv11039587:88 , srv1415428217:88 , srv1460435231:88 , srv1649901957:88 , srv1870114077:88 , srv2065134553:88 , srv2096174110:88 , srv310010128:88 , srv569100362:88 , srv818199638:88 , srv946564686:88 , srv1056868636:89 , srv1595387423:89 , srv1832014466:89 , srv2115026146:89 , srv1195356639:90 , srv1211885309:90 , srv1266044540:90 , srv2117666089:90 , srv260990529:90 , srv273146857:90 , srv321593813:90 , srv407543872:90 , srv528404917:90 , srv580709561:90 , srv654362220:90 , srv765815564:90 , srv1852123709:91 , srv872975944:91 , srv916271226:91 , srv942980964:91 , srv758658622:92 , srv717597470:534 }
2023-04-25 09:55:40,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:40,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1056868636=7, srv1659423183=32, srv2047716172=46, srv1000926970=0, srv939895422=94, srv1252943970=16, srv1074903945=9, srv2089184516=49, srv845710872=89, srv1038579382=4, srv1063668519=8, srv813918207=86, srv1942914433=42, srv1211885309=14, srv1531796034=26, srv448260872=65, srv1993706473=44, srv944967513=96, srv1415428217=21, srv1014686014=1, srv541974042=72, srv1452663122=22, srv2088551256=48, srv1852123709=38, srv2115026146=53, srv1843743440=36, srv780966982=85, srv11039587=10, srv1362946571=20, srv840515068=88, srv1291313170=19, srv259227499=58, srv403335375=63, srv46871746=67, srv1726298366=34, srv1649901957=31, srv1266044540=17, srv70973540=79, srv1041523118=6, srv2124729421=55, srv1671280221=33, srv537780606=71, srv1179127350=12, srv1845812525=37, srv2100904863=52, srv407543872=64, srv1498116616=24, srv1284216138=18, srv260990529=59, srv1523044162=25, srv603974435=75, srv2117666089=54, srv717597470=80, srv498436599=69, srv310010128=61, srv1195356639=13, srv1038809920=5, srv865422906=90, srv1213998909=15, srv1595387423=27, srv942980964=95, srv721624542=81, srv916271226=93, srv2096174110=51, srv964983343=99, srv1870114077=40, srv649074670=77, srv528404917=70, srv772516234=84, srv1159897839=11, srv654362220=78, srv619444640=76, srv497751954=68, srv818199638=87, srv1624041421=29, srv2090790245=50, srv765815564=83, srv1020162557=2, srv2065134553=47, srv196043703=43, srv872975944=91, srv946564686=97, srv273146857=60, srv1832014466=35, srv758658622=82, srv907708333=92, srv18920076=41, srv1025422806=3, srv321593813=62, srv228894383=56, srv252553706=57, srv1460435231=23, srv1863957916=39, srv1600890133=28, srv462169730=66, srv2009602994=45, srv580709561=74, srv569100362=73, srv9531320=98, srv1632106052=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:40,554 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:40,555 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:40,556 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 09:55:40,557 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 09:55:40,558 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 09:55:40,559 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 09:55:40,560 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 09:55:40,561 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 09:55:40,562 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 09:55:40,563 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 09:55:40,564 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 09:55:40,689 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02294449132156208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03513641844631533, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02294449132156208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:40,689 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 09:55:40,690 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014065409689496417, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02294449132156208); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03513641844631533, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02294449132156208); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04325, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 09:55:41,028 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 1041 regions; Going from a computed imbalance of 0.014065409689496417 to a new imbalance of 4.3476251676484077E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043479995844735156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006979205927323111); MoveCostFunction : (multiplier=7.0, imbalance=0.11566666666666667, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043479995844735156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:41,030 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1832014466:82 , srv2009602994:82 , srv273146857:82 , srv1195356639:83 , srv1211885309:83 , srv1671280221:83 , srv448260872:83 , srv603974435:83 , srv872975944:83 , srv1025422806:84 , srv1726298366:84 , srv2096174110:84 , srv2117666089:84 , srv260990529:84 , srv310010128:84 , srv321593813:84 , srv407543872:84 , srv462169730:84 , srv498436599:84 , srv541974042:84 , srv721624542:84 , srv916271226:84 , srv1213998909:85 , srv1460435231:85 , srv1595387423:85 , srv1624041421:85 , srv1632106052:85 , srv1649901957:85 , srv1870114077:85 , srv1993706473:85 , srv2065134553:85 , srv46871746:85 , srv528404917:85 , srv537780606:85 , srv569100362:85 , srv619444640:85 , srv649074670:85 , srv70973540:85 , srv772516234:85 , srv813918207:85 , srv845710872:85 , srv9531320:85 , srv1000926970:86 , srv1020162557:86 , srv1038579382:86 , srv1038809920:86 , srv1056868636:86 , srv1063668519:86 , srv1074903945:86 , srv11039587:86 , srv1179127350:86 , srv1266044540:86 , srv1291313170:86 , srv1362946571:86 , srv1415428217:86 , srv1600890133:86 , srv1843743440:86 , srv1852123709:86 , srv1863957916:86 , srv18920076:86 , srv196043703:86 , srv2088551256:86 , srv2090790245:86 , srv2100904863:86 , srv2115026146:86 , srv228894383:86 , srv259227499:86 , srv497751954:86 , srv580709561:86 , srv765815564:86 , srv818199638:86 , srv942980964:86 , srv1252943970:87 , srv1284216138:87 , srv1452663122:87 , srv1523044162:87 , srv2047716172:87 , srv2124729421:87 , srv252553706:87 , srv403335375:87 , srv654362220:87 , srv758658622:87 , srv780966982:87 , srv840515068:87 , srv865422906:87 , srv944967513:87 , srv964983343:87 , srv1014686014:88 , srv1041523118:88 , srv1159897839:88 , srv1659423183:88 , srv1942914433:88 , srv2089184516:88 , srv946564686:88 , srv1498116616:89 , srv1531796034:89 , srv1845812525:89 , srv907708333:89 , srv939895422:89 , srv717597470:518 }
2023-04-25 09:55:41,035 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:41,037 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1056868636=7, srv1659423183=32, srv2047716172=46, srv1000926970=0, srv939895422=94, srv1252943970=16, srv1074903945=9, srv2089184516=49, srv845710872=89, srv1038579382=4, srv1063668519=8, srv813918207=86, srv1942914433=42, srv1211885309=14, srv1531796034=26, srv448260872=65, srv1993706473=44, srv944967513=96, srv1415428217=21, srv1014686014=1, srv541974042=72, srv1452663122=22, srv2088551256=48, srv1852123709=38, srv2115026146=53, srv1843743440=36, srv780966982=85, srv11039587=10, srv1362946571=20, srv840515068=88, srv1291313170=19, srv259227499=58, srv403335375=63, srv46871746=67, srv1726298366=34, srv1649901957=31, srv1266044540=17, srv70973540=79, srv1041523118=6, srv2124729421=55, srv1671280221=33, srv537780606=71, srv1179127350=12, srv1845812525=37, srv2100904863=52, srv407543872=64, srv1498116616=24, srv1284216138=18, srv260990529=59, srv1523044162=25, srv603974435=75, srv2117666089=54, srv717597470=80, srv498436599=69, srv310010128=61, srv1195356639=13, srv1038809920=5, srv865422906=90, srv1213998909=15, srv1595387423=27, srv942980964=95, srv721624542=81, srv916271226=93, srv2096174110=51, srv964983343=99, srv1870114077=40, srv649074670=77, srv528404917=70, srv772516234=84, srv1159897839=11, srv654362220=78, srv619444640=76, srv497751954=68, srv818199638=87, srv1624041421=29, srv2090790245=50, srv765815564=83, srv1020162557=2, srv2065134553=47, srv196043703=43, srv872975944=91, srv946564686=97, srv273146857=60, srv1832014466=35, srv758658622=82, srv907708333=92, srv18920076=41, srv1025422806=3, srv321593813=62, srv228894383=56, srv252553706=57, srv1460435231=23, srv1863957916=39, srv1600890133=28, srv462169730=66, srv2009602994=45, srv580709561=74, srv569100362=73, srv9531320=98, srv1632106052=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:41,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:41,061 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:41,062 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:41,063 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 09:55:41,064 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 09:55:41,065 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 09:55:41,066 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 09:55:41,067 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 09:55:41,068 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 09:55:41,069 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 09:55:41,070 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 09:55:41,224 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043479995844735156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006979205927323111); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043479995844735156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:41,225 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-25 09:55:41,225 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.274732789688374E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0043479995844735156); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006979205927323111); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0043479995844735156); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.004166666666666667); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-25 09:55:41,574 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 486 ms to try 5000 different iterations.  Found a solution that moves 245 regions; Going from a computed imbalance of 4.274732789688374E-4 to a new imbalance of 1.8618076541774983E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.02722222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:41,575 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1014686014:83 , srv1041523118:83 , srv1179127350:83 , srv1523044162:83 , srv1531796034:83 , srv1843743440:83 , srv1852123709:83 , srv654362220:83 , srv765815564:83 , srv907708333:83 , srv946564686:83 , srv1000926970:84 , srv1056868636:84 , srv1063668519:84 , srv1074903945:84 , srv11039587:84 , srv1159897839:84 , srv1195356639:84 , srv1211885309:84 , srv1252943970:84 , srv1266044540:84 , srv1284216138:84 , srv1362946571:84 , srv1415428217:84 , srv1452663122:84 , srv1498116616:84 , srv1624041421:84 , srv1649901957:84 , srv1659423183:84 , srv1845812525:84 , srv1863957916:84 , srv1942914433:84 , srv196043703:84 , srv1993706473:84 , srv2047716172:84 , srv2065134553:84 , srv2089184516:84 , srv2096174110:84 , srv2117666089:84 , srv2124729421:84 , srv252553706:84 , srv259227499:84 , srv260990529:84 , srv310010128:84 , srv407543872:84 , srv46871746:84 , srv528404917:84 , srv537780606:84 , srv580709561:84 , srv649074670:84 , srv758658622:84 , srv772516234:84 , srv780966982:84 , srv840515068:84 , srv916271226:84 , srv939895422:84 , srv944967513:84 , srv964983343:84 , srv1020162557:85 , srv1025422806:85 , srv1038579382:85 , srv1038809920:85 , srv1213998909:85 , srv1291313170:85 , srv1460435231:85 , srv1595387423:85 , srv1600890133:85 , srv1726298366:85 , srv1832014466:85 , srv18920076:85 , srv2009602994:85 , srv2090790245:85 , srv2100904863:85 , srv2115026146:85 , srv228894383:85 , srv273146857:85 , srv321593813:85 , srv403335375:85 , srv462169730:85 , srv497751954:85 , srv541974042:85 , srv569100362:85 , srv619444640:85 , srv70973540:85 , srv721624542:85 , srv813918207:85 , srv818199638:85 , srv845710872:85 , srv865422906:85 , srv872975944:85 , srv942980964:85 , srv9531320:85 , srv1632106052:86 , srv1671280221:86 , srv1870114077:86 , srv2088551256:86 , srv448260872:86 , srv498436599:86 , srv603974435:87 , srv717597470:646 }
2023-04-25 09:55:41,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:41,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1056868636=7, srv1659423183=32, srv2047716172=46, srv1000926970=0, srv939895422=94, srv1252943970=16, srv1074903945=9, srv2089184516=49, srv845710872=89, srv1038579382=4, srv1063668519=8, srv813918207=86, srv1942914433=42, srv1211885309=14, srv1531796034=26, srv448260872=65, srv1993706473=44, srv944967513=96, srv1415428217=21, srv1014686014=1, srv541974042=72, srv1452663122=22, srv2088551256=48, srv1852123709=38, srv2115026146=53, srv1843743440=36, srv780966982=85, srv11039587=10, srv1362946571=20, srv840515068=88, srv1291313170=19, srv259227499=58, srv403335375=63, srv46871746=67, srv1726298366=34, srv1649901957=31, srv1266044540=17, srv70973540=79, srv1041523118=6, srv2124729421=55, srv1671280221=33, srv537780606=71, srv1179127350=12, srv1845812525=37, srv2100904863=52, srv407543872=64, srv1498116616=24, srv1284216138=18, srv260990529=59, srv1523044162=25, srv603974435=75, srv2117666089=54, srv717597470=80, srv498436599=69, srv310010128=61, srv1195356639=13, srv1038809920=5, srv865422906=90, srv1213998909=15, srv1595387423=27, srv942980964=95, srv721624542=81, srv916271226=93, srv2096174110=51, srv964983343=99, srv1870114077=40, srv649074670=77, srv528404917=70, srv772516234=84, srv1159897839=11, srv654362220=78, srv619444640=76, srv497751954=68, srv818199638=87, srv1624041421=29, srv2090790245=50, srv765815564=83, srv1020162557=2, srv2065134553=47, srv196043703=43, srv872975944=91, srv946564686=97, srv273146857=60, srv1832014466=35, srv758658622=82, srv907708333=92, srv18920076=41, srv1025422806=3, srv321593813=62, srv228894383=56, srv252553706=57, srv1460435231=23, srv1863957916=39, srv1600890133=28, srv462169730=66, srv2009602994=45, srv580709561=74, srv569100362=73, srv9531320=98, srv1632106052=30} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:41,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:41,599 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:41,600 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:41,601 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-25 09:55:41,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-25 09:55:41,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-25 09:55:41,604 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-25 09:55:41,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-25 09:55:41,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-25 09:55:41,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-25 09:55:41,605 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-25 09:55:41,606 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-25 09:55:41,607 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-25 09:55:41,608 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-25 09:55:41,762 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.6902549875088312E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.178341294946416E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0016412198797244363); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.178341294946416E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:41,762 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1014686014:83 , srv1041523118:83 , srv1179127350:83 , srv1523044162:83 , srv1531796034:83 , srv1843743440:83 , srv1852123709:83 , srv654362220:83 , srv765815564:83 , srv907708333:83 , srv946564686:83 , srv1000926970:84 , srv1056868636:84 , srv1063668519:84 , srv1074903945:84 , srv11039587:84 , srv1159897839:84 , srv1195356639:84 , srv1211885309:84 , srv1252943970:84 , srv1266044540:84 , srv1284216138:84 , srv1362946571:84 , srv1415428217:84 , srv1452663122:84 , srv1498116616:84 , srv1624041421:84 , srv1649901957:84 , srv1659423183:84 , srv1845812525:84 , srv1863957916:84 , srv1942914433:84 , srv196043703:84 , srv1993706473:84 , srv2047716172:84 , srv2065134553:84 , srv2089184516:84 , srv2096174110:84 , srv2117666089:84 , srv2124729421:84 , srv252553706:84 , srv259227499:84 , srv260990529:84 , srv310010128:84 , srv407543872:84 , srv46871746:84 , srv528404917:84 , srv537780606:84 , srv580709561:84 , srv649074670:84 , srv758658622:84 , srv772516234:84 , srv780966982:84 , srv840515068:84 , srv916271226:84 , srv939895422:84 , srv944967513:84 , srv964983343:84 , srv1020162557:85 , srv1025422806:85 , srv1038579382:85 , srv1038809920:85 , srv1213998909:85 , srv1291313170:85 , srv1460435231:85 , srv1595387423:85 , srv1600890133:85 , srv1726298366:85 , srv1832014466:85 , srv18920076:85 , srv2009602994:85 , srv2090790245:85 , srv2100904863:85 , srv2115026146:85 , srv228894383:85 , srv273146857:85 , srv321593813:85 , srv403335375:85 , srv462169730:85 , srv497751954:85 , srv541974042:85 , srv569100362:85 , srv619444640:85 , srv70973540:85 , srv721624542:85 , srv813918207:85 , srv818199638:85 , srv845710872:85 , srv865422906:85 , srv872975944:85 , srv942980964:85 , srv9531320:85 , srv1632106052:86 , srv1671280221:86 , srv1870114077:86 , srv2088551256:86 , srv448260872:86 , srv498436599:86 , srv603974435:87 , srv717597470:646 }
2023-04-25 09:55:41,804 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=422 (was 380) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 170), AvailableMemoryMB=4504 (was 4992)
2023-04-25 09:55:41,815 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=422, ProcessCount=170, AvailableMemoryMB=4504
2023-04-25 09:55:41,816 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-25 09:55:41,816 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-25 09:55:41,831 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1168587417:84 , srv1258435368:84 , srv129552965:84 , srv137969103:84 , srv1390534829:84 , srv1519513180:84 , srv1542177970:84 , srv1546800452:84 , srv1605463356:84 , srv1647850399:84 , srv1752804292:84 , srv1759781869:84 , srv1764465190:84 , srv1838708076:84 , srv1997915811:84 , srv2084779816:84 , srv242905732:84 , srv252503879:84 , srv261492403:84 , srv273756596:84 , srv311251582:84 , srv339619003:84 , srv412093069:84 , srv417732218:84 , srv592566774:84 , srv618571376:84 , srv697832002:84 , srv706830303:84 , srv875877171:84 , srv656686430:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-25 09:55:41,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:55:41,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1759781869=11, srv875877171=29, srv2084779816=15, srv261492403=18, srv1546800452=7, srv252503879=17, srv697832002=27, srv1519513180=5, srv273756596=19, srv1838708076=13, srv129552965=2, srv1997915811=14, srv1752804292=10, srv706830303=28, srv618571376=25, srv1647850399=9, srv1390534829=4, srv242905732=16, srv339619003=21, srv1764465190=12, srv1605463356=8, srv656686430=26, srv417732218=23, srv592566774=24, srv137969103=3, srv1542177970=6, srv1258435368=1, srv1168587417=0, srv311251582=20, srv412093069=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:55:41,849 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:55:41,850 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:55:41,851 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:55:41,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:55:41,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:55:41,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:55:41,852 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 09:55:41,879 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1428041103802369, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:55:41,882 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912643014353103, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1428041103802369, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-25 09:57:41,858 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6705656 different iterations.  Found a solution that moves 1856 regions; Going from a computed imbalance of 0.9912643014353103 to a new imbalance of 4.3319965896196796E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6874074074074074, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:57:41,866 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1168587417:90 , srv1258435368:90 , srv129552965:90 , srv137969103:90 , srv1390534829:90 , srv1519513180:90 , srv1542177970:90 , srv1546800452:90 , srv1605463356:90 , srv1647850399:90 , srv1752804292:90 , srv1759781869:90 , srv1764465190:90 , srv1838708076:90 , srv1997915811:90 , srv2084779816:90 , srv242905732:90 , srv252503879:90 , srv261492403:90 , srv273756596:90 , srv311251582:90 , srv339619003:90 , srv412093069:90 , srv417732218:90 , srv592566774:90 , srv618571376:90 , srv656686430:90 , srv697832002:90 , srv706830303:90 , srv875877171:90 }
2023-04-25 09:57:41,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-25 09:57:41,868 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1759781869=11, srv875877171=29, srv2084779816=15, srv261492403=18, srv1546800452=7, srv252503879=17, srv697832002=27, srv1519513180=5, srv273756596=19, srv1838708076=13, srv129552965=2, srv1997915811=14, srv1752804292=10, srv706830303=28, srv618571376=25, srv1647850399=9, srv1390534829=4, srv242905732=16, srv339619003=21, srv1764465190=12, srv1605463356=8, srv656686430=26, srv417732218=23, srv592566774=24, srv137969103=3, srv1542177970=6, srv1258435368=1, srv1168587417=0, srv311251582=20, srv412093069=22} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-25 09:57:41,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-25 09:57:41,873 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-25 09:57:41,874 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-25 09:57:41,875 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-25 09:57:41,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-25 09:57:41,876 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-25 09:57:41,892 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-25 09:57:41,892 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1168587417:90 , srv1258435368:90 , srv129552965:90 , srv137969103:90 , srv1390534829:90 , srv1519513180:90 , srv1542177970:90 , srv1546800452:90 , srv1605463356:90 , srv1647850399:90 , srv1752804292:90 , srv1759781869:90 , srv1764465190:90 , srv1838708076:90 , srv1997915811:90 , srv2084779816:90 , srv242905732:90 , srv252503879:90 , srv261492403:90 , srv273756596:90 , srv311251582:90 , srv339619003:90 , srv412093069:90 , srv417732218:90 , srv592566774:90 , srv618571376:90 , srv656686430:90 , srv697832002:90 , srv706830303:90 , srv875877171:90 }
2023-04-25 09:57:41,915 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=394 (was 422), ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=4428 (was 4504)