2023-05-06 02:53:38,536 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-05-06 02:53:38,865 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-05-06 02:53:38,971 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-05-06 02:53:39,041 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 02:53:39,051 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-06 02:53:39,066 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=179, AvailableMemoryMB=5109
2023-05-06 02:53:39,068 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 02:53:39,069 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-05-06 02:53:39,211 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1003621134:84 , srv10360620:84 , srv1074046259:84 , srv1074643747:84 , srv1159897925:84 , srv1180400027:84 , srv1227719210:84 , srv1267156633:84 , srv1279991539:84 , srv130464621:84 , srv1332979899:84 , srv1350811082:84 , srv1370532660:84 , srv1380358858:84 , srv1384930280:84 , srv1395762472:84 , srv1417145121:84 , srv1436246650:84 , srv1443269056:84 , srv1460628582:84 , srv1502573738:84 , srv1513805922:84 , srv1566908021:84 , srv1567786187:84 , srv1645114524:84 , srv1656716916:84 , srv1703566923:84 , srv171840167:84 , srv174563063:84 , srv1748734079:84 , srv1761809242:84 , srv1786766822:84 , srv1790047009:84 , srv1800906864:84 , srv1803226827:84 , srv1827270980:84 , srv1832339010:84 , srv187057538:84 , srv1877242581:84 , srv1877540869:84 , srv1889295666:84 , srv1890944545:84 , srv1898031299:84 , srv1903216994:84 , srv1910745647:84 , srv1913966968:84 , srv1917717025:84 , srv1919248017:84 , srv1942712559:84 , srv1943283703:84 , srv1945766798:84 , srv1963749236:84 , srv1979925672:84 , srv1998843414:84 , srv2037681805:84 , srv2040386884:84 , srv2090467944:84 , srv2103735684:84 , srv2134853926:84 , srv2145774418:84 , srv258934157:84 , srv267859109:84 , srv273771602:84 , srv329503795:84 , srv339548569:84 , srv342938309:84 , srv358776764:84 , srv40796540:84 , srv422241507:84 , srv423043533:84 , srv423650110:84 , srv424008756:84 , srv457362916:84 , srv470372305:84 , srv502467776:84 , srv51965583:84 , srv520695277:84 , srv526993405:84 , srv541703129:84 , srv563833349:84 , srv565237085:84 , srv586682347:84 , srv618905445:84 , srv662394169:84 , srv676606393:84 , srv713047642:84 , srv723793033:84 , srv725941357:84 , srv767772314:84 , srv79285109:84 , srv847763828:84 , srv863670222:84 , srv867964222:84 , srv89699735:84 , srv918627987:84 , srv948281125:84 , srv992497355:84 , srv994381796:84 , srv996934894:84 , srv1828831607:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-05-06 02:53:39,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:39,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:39,339 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:39,340 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:39,341 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:39,342 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:39,343 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:39,344 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:39,345 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:39,346 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:39,347 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:39,348 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:39,685 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:39,686 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 02:53:39,686 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 02:53:40,441 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1070 ms to try 5000 different iterations.  Found a solution that moves 4684 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17751189084159363. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04063009155408376, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05421617783829785, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5204444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04063009155408376, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17225, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.244, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:40,457 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv2134853926:80 , srv174563063:81 , srv767772314:81 , srv2037681805:82 , srv470372305:82 , srv1003621134:83 , srv1074643747:83 , srv1800906864:83 , srv1963749236:83 , srv267859109:83 , srv273771602:83 , srv358776764:83 , srv40796540:83 , srv992497355:83 , srv1384930280:84 , srv1566908021:84 , srv1656716916:84 , srv1748734079:84 , srv1877242581:84 , srv1903216994:84 , srv1919248017:84 , srv1942712559:84 , srv258934157:84 , srv918627987:84 , srv996934894:84 , srv1513805922:85 , srv1567786187:85 , srv1761809242:85 , srv1827270980:85 , srv1832339010:85 , srv1945766798:85 , srv2090467944:85 , srv2145774418:85 , srv329503795:85 , srv51965583:85 , srv563833349:85 , srv565237085:85 , srv662394169:85 , srv867964222:85 , srv1074046259:86 , srv1332979899:86 , srv1350811082:86 , srv1370532660:86 , srv1703566923:86 , srv1803226827:86 , srv187057538:86 , srv1889295666:86 , srv1910745647:86 , srv1943283703:86 , srv2103735684:86 , srv339548569:86 , srv423043533:86 , srv520695277:86 , srv586682347:86 , srv863670222:86 , srv89699735:86 , srv994381796:86 , srv1227719210:87 , srv1380358858:87 , srv1443269056:87 , srv1502573738:87 , srv171840167:87 , srv1786766822:87 , srv1913966968:87 , srv342938309:87 , srv618905445:87 , srv847763828:87 , srv10360620:88 , srv1159897925:88 , srv1267156633:88 , srv1645114524:88 , srv1898031299:88 , srv1998843414:88 , srv422241507:88 , srv423650110:88 , srv502467776:88 , srv526993405:88 , srv676606393:88 , srv79285109:88 , srv1395762472:89 , srv1790047009:89 , srv1877540869:89 , srv1890944545:89 , srv2040386884:89 , srv713047642:89 , srv723793033:89 , srv725941357:89 , srv1417145121:90 , srv1917717025:90 , srv1979925672:90 , srv424008756:90 , srv457362916:90 , srv130464621:91 , srv1460628582:91 , srv1180400027:92 , srv541703129:92 , srv948281125:92 , srv1279991539:94 , srv1436246650:94 , srv1828831607:451 }
2023-05-06 02:53:40,464 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:40,465 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:40,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:40,498 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:40,499 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:40,500 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:40,501 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:40,502 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:40,503 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:40,504 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:40,505 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:40,506 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:40,507 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:40,508 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:40,509 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:40,510 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:40,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:40,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:40,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:40,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:40,511 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:40,734 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04063009155408376, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05421617783829785, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04063009155408376, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17225, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.244, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:40,735 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 02:53:40,735 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17747909277258644, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.04063009155408376, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05421617783829785, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.04063009155408376, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17225, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.244, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 02:53:41,078 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 533 ms to try 5000 different iterations.  Found a solution that moves 2653 regions; Going from a computed imbalance of 0.17747909277258644 to a new imbalance of 0.016597041675718113. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021411123604140197); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031729071948829624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.2947777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021411123604140197); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:41,091 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1279991539:77 , srv1436246650:77 , srv1417145121:80 , srv723793033:80 , srv948281125:80 , srv130464621:81 , srv541703129:81 , srv1227719210:82 , srv1790047009:82 , srv676606393:82 , srv1180400027:83 , srv1877540869:83 , srv1890944545:83 , srv2090467944:83 , srv424008756:83 , srv526993405:83 , srv713047642:83 , srv725941357:83 , srv994381796:83 , srv1395762472:84 , srv1645114524:84 , srv171840167:84 , srv1898031299:84 , srv1917717025:84 , srv1943283703:84 , srv1998843414:84 , srv2103735684:84 , srv422241507:84 , srv457362916:84 , srv618905445:84 , srv662394169:84 , srv79285109:84 , srv1159897925:85 , srv1350811082:85 , srv1443269056:85 , srv1460628582:85 , srv1703566923:85 , srv1803226827:85 , srv1832339010:85 , srv1889295666:85 , srv1913966968:85 , srv1979925672:85 , srv339548569:85 , srv342938309:85 , srv423043533:85 , srv502467776:85 , srv520695277:85 , srv586682347:85 , srv10360620:86 , srv1370532660:86 , srv1502573738:86 , srv1827270980:86 , srv187057538:86 , srv1919248017:86 , srv329503795:86 , srv423650110:86 , srv863670222:86 , srv1074046259:87 , srv1074643747:87 , srv1267156633:87 , srv1332979899:87 , srv1380358858:87 , srv1513805922:87 , srv1566908021:87 , srv1656716916:87 , srv1786766822:87 , srv2145774418:87 , srv258934157:87 , srv273771602:87 , srv40796540:87 , srv51965583:87 , srv565237085:87 , srv847763828:87 , srv1384930280:88 , srv1748734079:88 , srv1761809242:88 , srv1877242581:88 , srv1903216994:88 , srv1910745647:88 , srv2037681805:88 , srv2040386884:88 , srv470372305:88 , srv563833349:88 , srv867964222:88 , srv918627987:88 , srv992497355:88 , srv1567786187:89 , srv1963749236:89 , srv267859109:89 , srv358776764:89 , srv1800906864:90 , srv89699735:90 , srv996934894:90 , srv1003621134:91 , srv174563063:91 , srv1942712559:92 , srv1945766798:92 , srv2134853926:92 , srv767772314:92 , srv1828831607:513 }
2023-05-06 02:53:41,097 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:41,098 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:41,111 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:41,112 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:41,113 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:41,114 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:41,115 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:41,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:41,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:41,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:41,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:41,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:41,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021411123604140197); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031729071948829624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021411123604140197); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:41,294 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 02:53:41,294 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01657846497267028, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.021411123604140197); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.031729071948829624, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.021411123604140197); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.013583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.04558333333333333, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 02:53:41,632 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 476 ms to try 5000 different iterations.  Found a solution that moves 1015 regions; Going from a computed imbalance of 0.01657846497267028 to a new imbalance of 0.0011722369922522763. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006777970963742381); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011585818956718922); MoveCostFunction : (multiplier=7.0, imbalance=0.11277777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006777970963742381); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:41,635 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1945766798:80 , srv2040386884:80 , srv1460628582:82 , srv1942712559:82 , srv89699735:82 , srv10360620:83 , srv1180400027:83 , srv1267156633:83 , srv1380358858:83 , srv1567786187:83 , srv1786766822:83 , srv1910745647:83 , srv1979925672:83 , srv423650110:83 , srv424008756:83 , srv847763828:83 , srv996934894:83 , srv1003621134:84 , srv1074046259:84 , srv1159897925:84 , srv1370532660:84 , srv1502573738:84 , srv1800906864:84 , srv1917717025:84 , srv2145774418:84 , srv457362916:84 , srv502467776:84 , srv767772314:84 , srv867964222:84 , srv1332979899:85 , srv1395762472:85 , srv1436246650:85 , srv1443269056:85 , srv1513805922:85 , srv1645114524:85 , srv174563063:85 , srv1748734079:85 , srv1877242581:85 , srv1898031299:85 , srv1913966968:85 , srv1963749236:85 , srv267859109:85 , srv342938309:85 , srv51965583:85 , srv563833349:85 , srv565237085:85 , srv725941357:85 , srv863670222:85 , srv948281125:85 , srv992497355:85 , srv1279991539:86 , srv130464621:86 , srv1350811082:86 , srv1384930280:86 , srv1566908021:86 , srv1761809242:86 , srv1790047009:86 , srv1803226827:86 , srv187057538:86 , srv1877540869:86 , srv1890944545:86 , srv1903216994:86 , srv1998843414:86 , srv2134853926:86 , srv258934157:86 , srv358776764:86 , srv520695277:86 , srv541703129:86 , srv618905445:86 , srv713047642:86 , srv918627987:86 , srv1074643747:87 , srv1417145121:87 , srv1656716916:87 , srv1703566923:87 , srv171840167:87 , srv1827270980:87 , srv1832339010:87 , srv1889295666:87 , srv1943283703:87 , srv2037681805:87 , srv2103735684:87 , srv273771602:87 , srv329503795:87 , srv339548569:87 , srv40796540:87 , srv423043533:87 , srv470372305:87 , srv526993405:87 , srv586682347:87 , srv79285109:87 , srv1227719210:88 , srv1919248017:88 , srv2090467944:88 , srv422241507:88 , srv676606393:88 , srv723793033:88 , srv994381796:88 , srv662394169:89 , srv1828831607:554 }
2023-05-06 02:53:41,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:41,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:41,660 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:41,661 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:41,662 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:41,663 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:41,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:41,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:41,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:41,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:41,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:41,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:41,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:41,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:41,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:41,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:41,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:41,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:41,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:41,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:41,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:41,798 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006777970963742381); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011585818956718922); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006777970963742381); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:41,798 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 02:53:41,798 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.0011651298103474313, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.006777970963742381); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.011585818956718922); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.006777970963742381); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=7.5E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0045); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 02:53:42,092 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 402 ms to try 5000 different iterations.  Found a solution that moves 290 regions; Going from a computed imbalance of 0.0011651298103474313 to a new imbalance of 4.3467993310819464E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.03222222222222222, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:42,093 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1761809242:83 , srv1790047009:83 , srv422241507:83 , srv79285109:83 , srv1227719210:84 , srv1267156633:84 , srv130464621:84 , srv1384930280:84 , srv1443269056:84 , srv1460628582:84 , srv1502573738:84 , srv1566908021:84 , srv1656716916:84 , srv1703566923:84 , srv171840167:84 , srv1827270980:84 , srv187057538:84 , srv1877540869:84 , srv1890944545:84 , srv1903216994:84 , srv1917717025:84 , srv1919248017:84 , srv1942712559:84 , srv1979925672:84 , srv1998843414:84 , srv2103735684:84 , srv2134853926:84 , srv329503795:84 , srv339548569:84 , srv358776764:84 , srv423043533:84 , srv457362916:84 , srv526993405:84 , srv541703129:84 , srv563833349:84 , srv586682347:84 , srv662394169:84 , srv676606393:84 , srv713047642:84 , srv863670222:84 , srv89699735:84 , srv918627987:84 , srv1003621134:85 , srv10360620:85 , srv1074046259:85 , srv1074643747:85 , srv1159897925:85 , srv1180400027:85 , srv1279991539:85 , srv1332979899:85 , srv1350811082:85 , srv1370532660:85 , srv1380358858:85 , srv1395762472:85 , srv1417145121:85 , srv1513805922:85 , srv1567786187:85 , srv1645114524:85 , srv174563063:85 , srv1748734079:85 , srv1786766822:85 , srv1800906864:85 , srv1803226827:85 , srv1832339010:85 , srv1889295666:85 , srv1898031299:85 , srv1913966968:85 , srv1943283703:85 , srv1945766798:85 , srv1963749236:85 , srv2037681805:85 , srv2040386884:85 , srv2090467944:85 , srv2145774418:85 , srv258934157:85 , srv267859109:85 , srv273771602:85 , srv40796540:85 , srv423650110:85 , srv470372305:85 , srv502467776:85 , srv51965583:85 , srv520695277:85 , srv565237085:85 , srv618905445:85 , srv723793033:85 , srv725941357:85 , srv767772314:85 , srv847763828:85 , srv867964222:85 , srv948281125:85 , srv994381796:85 , srv996934894:85 , srv1436246650:86 , srv1877242581:86 , srv1910745647:86 , srv342938309:86 , srv992497355:86 , srv424008756:87 , srv1828831607:624 }
2023-05-06 02:53:42,099 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:42,100 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:42,116 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:42,117 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:42,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:42,119 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:42,120 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:42,121 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:42,122 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:42,123 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:42,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:42,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:42,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:42,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:42,124 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:42,274 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:42,274 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-05-06 02:53:42,275 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=4.143736990943523E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.470732932414788E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.470732932414788E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=3.333333333333333E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-05-06 02:53:42,564 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 428 ms to try 5000 different iterations.  Found a solution that moves 37 regions; Going from a computed imbalance of 4.143736990943523E-5 to a new imbalance of 6.2911582771463565E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.004111111111111111); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:42,564 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1003621134:83 , srv1180400027:83 , srv1332979899:83 , srv1395762472:83 , srv1877242581:83 , srv1889295666:83 , srv1910745647:83 , srv342938309:83 , srv422241507:83 , srv424008756:83 , srv541703129:83 , srv10360620:84 , srv1074046259:84 , srv1074643747:84 , srv1159897925:84 , srv1267156633:84 , srv1279991539:84 , srv130464621:84 , srv1350811082:84 , srv1380358858:84 , srv1384930280:84 , srv1417145121:84 , srv1436246650:84 , srv1460628582:84 , srv1513805922:84 , srv1567786187:84 , srv1645114524:84 , srv1656716916:84 , srv1703566923:84 , srv171840167:84 , srv174563063:84 , srv1748734079:84 , srv1761809242:84 , srv1786766822:84 , srv1800906864:84 , srv1803226827:84 , srv1827270980:84 , srv1832339010:84 , srv187057538:84 , srv1877540869:84 , srv1890944545:84 , srv1898031299:84 , srv1903216994:84 , srv1913966968:84 , srv1917717025:84 , srv1919248017:84 , srv1942712559:84 , srv1943283703:84 , srv1945766798:84 , srv1963749236:84 , srv1979925672:84 , srv1998843414:84 , srv2037681805:84 , srv2040386884:84 , srv2134853926:84 , srv258934157:84 , srv267859109:84 , srv273771602:84 , srv329503795:84 , srv339548569:84 , srv358776764:84 , srv40796540:84 , srv423043533:84 , srv423650110:84 , srv457362916:84 , srv470372305:84 , srv502467776:84 , srv51965583:84 , srv520695277:84 , srv526993405:84 , srv563833349:84 , srv565237085:84 , srv586682347:84 , srv618905445:84 , srv662394169:84 , srv676606393:84 , srv713047642:84 , srv723793033:84 , srv725941357:84 , srv767772314:84 , srv79285109:84 , srv847763828:84 , srv867964222:84 , srv89699735:84 , srv918627987:84 , srv948281125:84 , srv992497355:84 , srv994381796:84 , srv996934894:84 , srv1227719210:85 , srv1370532660:85 , srv1443269056:85 , srv1502573738:85 , srv1566908021:85 , srv2090467944:85 , srv2103735684:85 , srv2145774418:85 , srv863670222:85 , srv1790047009:86 , srv1828831607:684 }
2023-05-06 02:53:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:42,570 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1417145121=16, srv1460628582=19, srv1513805922=21, srv563833349=80, srv767772314=89, srv339548569=65, srv174563063=28, srv725941357=88, srv1003621134=0, srv1502573738=20, srv918627987=95, srv1159897925=4, srv130464621=9, srv1436246650=17, srv1748734079=29, srv2090467944=57, srv948281125=96, srv526993405=78, srv1903216994=44, srv1945766798=51, srv187057538=38, srv723793033=87, srv1827270980=35, srv1761809242=30, srv1963749236=52, srv10360620=1, srv40796540=68, srv586682347=82, srv1567786187=23, srv329503795=64, srv992497355=97, srv2037681805=55, srv863670222=92, srv1703566923=26, srv1800906864=33, srv867964222=93, srv1803226827=34, srv1566908021=22, srv1227719210=6, srv502467776=75, srv422241507=69, srv541703129=79, srv1942712559=49, srv1332979899=10, srv79285109=90, srv457362916=73, srv1786766822=31, srv1917717025=47, srv1890944545=42, srv713047642=86, srv520695277=77, srv1645114524=24, srv994381796=98, srv258934157=61, srv424008756=72, srv1898031299=43, srv1877242581=39, srv342938309=66, srv1180400027=5, srv171840167=27, srv1832339010=37, srv1443269056=18, srv358776764=67, srv1656716916=25, srv2145774418=60, srv1790047009=32, srv1877540869=40, srv1943283703=50, srv1279991539=8, srv1913966968=46, srv618905445=83, srv1074643747=3, srv1074046259=2, srv89699735=94, srv996934894=99, srv1384930280=14, srv273771602=63, srv1350811082=11, srv1919248017=48, srv470372305=74, srv2040386884=56, srv847763828=91, srv1395762472=15, srv2134853926=59, srv1910745647=45, srv1828831607=36, srv51965583=76, srv676606393=85, srv1998843414=54, srv423650110=71, srv2103735684=58, srv1380358858=13, srv267859109=62, srv662394169=84, srv1979925672=53, srv565237085=81, srv1267156633=7, srv1370532660=12, srv1889295666=41, srv423043533=70} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:42,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:42,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-05-06 02:53:42,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-05-06 02:53:42,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-05-06 02:53:42,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-05-06 02:53:42,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-05-06 02:53:42,593 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-05-06 02:53:42,594 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-05-06 02:53:42,746 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.032078739728369E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0013400504203456161); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:42,746 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1003621134:83 , srv1180400027:83 , srv1332979899:83 , srv1395762472:83 , srv1877242581:83 , srv1889295666:83 , srv1910745647:83 , srv342938309:83 , srv422241507:83 , srv424008756:83 , srv541703129:83 , srv10360620:84 , srv1074046259:84 , srv1074643747:84 , srv1159897925:84 , srv1267156633:84 , srv1279991539:84 , srv130464621:84 , srv1350811082:84 , srv1380358858:84 , srv1384930280:84 , srv1417145121:84 , srv1436246650:84 , srv1460628582:84 , srv1513805922:84 , srv1567786187:84 , srv1645114524:84 , srv1656716916:84 , srv1703566923:84 , srv171840167:84 , srv174563063:84 , srv1748734079:84 , srv1761809242:84 , srv1786766822:84 , srv1800906864:84 , srv1803226827:84 , srv1827270980:84 , srv1832339010:84 , srv187057538:84 , srv1877540869:84 , srv1890944545:84 , srv1898031299:84 , srv1903216994:84 , srv1913966968:84 , srv1917717025:84 , srv1919248017:84 , srv1942712559:84 , srv1943283703:84 , srv1945766798:84 , srv1963749236:84 , srv1979925672:84 , srv1998843414:84 , srv2037681805:84 , srv2040386884:84 , srv2134853926:84 , srv258934157:84 , srv267859109:84 , srv273771602:84 , srv329503795:84 , srv339548569:84 , srv358776764:84 , srv40796540:84 , srv423043533:84 , srv423650110:84 , srv457362916:84 , srv470372305:84 , srv502467776:84 , srv51965583:84 , srv520695277:84 , srv526993405:84 , srv563833349:84 , srv565237085:84 , srv586682347:84 , srv618905445:84 , srv662394169:84 , srv676606393:84 , srv713047642:84 , srv723793033:84 , srv725941357:84 , srv767772314:84 , srv79285109:84 , srv847763828:84 , srv867964222:84 , srv89699735:84 , srv918627987:84 , srv948281125:84 , srv992497355:84 , srv994381796:84 , srv996934894:84 , srv1227719210:85 , srv1370532660:85 , srv1443269056:85 , srv1502573738:85 , srv1566908021:85 , srv2090467944:85 , srv2103735684:85 , srv2145774418:85 , srv863670222:85 , srv1790047009:86 , srv1828831607:684 }
2023-05-06 02:53:42,774 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=383 (was 364) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=4228 (was 5109)
2023-05-06 02:53:42,783 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=383, ProcessCount=179, AvailableMemoryMB=4227
2023-05-06 02:53:42,784 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-05-06 02:53:42,785 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-05-06 02:53:42,797 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1191791813:84 , srv1233387196:84 , srv1241378483:84 , srv1301731992:84 , srv133208769:84 , srv1420585874:84 , srv1444371294:84 , srv1551420570:84 , srv1610075745:84 , srv1693613587:84 , srv1724551387:84 , srv1774017526:84 , srv178314745:84 , srv1822371837:84 , srv1869548409:84 , srv1976237711:84 , srv1991074406:84 , srv2121864103:84 , srv216119646:84 , srv247335170:84 , srv362335261:84 , srv36740262:84 , srv427037418:84 , srv455766429:84 , srv491149884:84 , srv522434444:84 , srv663122882:84 , srv72095811:84 , srv760066708:84 , srv798641324:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-05-06 02:53:42,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:53:42,799 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv427037418=22, srv1693613587=9, srv36740262=21, srv1444371294=6, srv1610075745=8, srv1191791813=0, srv247335170=19, srv1551420570=7, srv1822371837=13, srv216119646=18, srv1869548409=14, srv362335261=20, srv133208769=4, srv491149884=24, srv1420585874=5, srv522434444=25, srv1774017526=11, srv1976237711=15, srv72095811=27, srv1233387196=1, srv1301731992=3, srv1991074406=16, srv798641324=29, srv760066708=28, srv2121864103=17, srv1241378483=2, srv178314745=12, srv1724551387=10, srv455766429=23, srv663122882=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:53:42,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:53:42,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:53:42,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:53:42,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:53:42,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:53:42,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:53:42,815 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:53:42,816 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-06 02:53:42,843 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0713190998559277, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:53:42,843 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912417767419144, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0713190998559277, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-05-06 02:55:42,820 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6988841 different iterations.  Found a solution that moves 1853 regions; Going from a computed imbalance of 0.9912417767419144 to a new imbalance of 4.324994439959734E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6862962962962963, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:55:42,828 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1191791813:90 , srv1233387196:90 , srv1241378483:90 , srv1301731992:90 , srv133208769:90 , srv1420585874:90 , srv1444371294:90 , srv1551420570:90 , srv1610075745:90 , srv1693613587:90 , srv1724551387:90 , srv1774017526:90 , srv178314745:90 , srv1822371837:90 , srv1869548409:90 , srv1976237711:90 , srv1991074406:90 , srv2121864103:90 , srv216119646:90 , srv247335170:90 , srv362335261:90 , srv36740262:90 , srv427037418:90 , srv455766429:90 , srv491149884:90 , srv522434444:90 , srv663122882:90 , srv72095811:90 , srv760066708:90 , srv798641324:90 }
2023-05-06 02:55:42,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-05-06 02:55:42,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv427037418=22, srv1693613587=9, srv36740262=21, srv1444371294=6, srv1610075745=8, srv1191791813=0, srv247335170=19, srv1551420570=7, srv1822371837=13, srv216119646=18, srv1869548409=14, srv362335261=20, srv133208769=4, srv491149884=24, srv1420585874=5, srv522434444=25, srv1774017526=11, srv1976237711=15, srv72095811=27, srv1233387196=1, srv1301731992=3, srv1991074406=16, srv798641324=29, srv760066708=28, srv2121864103=17, srv1241378483=2, srv178314745=12, srv1724551387=10, srv455766429=23, srv663122882=26} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-05-06 02:55:42,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-05-06 02:55:42,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-05-06 02:55:42,850 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-05-06 02:55:42,850 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1191791813:90 , srv1233387196:90 , srv1241378483:90 , srv1301731992:90 , srv133208769:90 , srv1420585874:90 , srv1444371294:90 , srv1551420570:90 , srv1610075745:90 , srv1693613587:90 , srv1724551387:90 , srv1774017526:90 , srv178314745:90 , srv1822371837:90 , srv1869548409:90 , srv1976237711:90 , srv1991074406:90 , srv2121864103:90 , srv216119646:90 , srv247335170:90 , srv362335261:90 , srv36740262:90 , srv427037418:90 , srv455766429:90 , srv491149884:90 , srv522434444:90 , srv663122882:90 , srv72095811:90 , srv760066708:90 , srv798641324:90 }
2023-05-06 02:55:42,867 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 383), ProcessCount=179 (was 179), AvailableMemoryMB=4381 (was 4227) - AvailableMemoryMB LEAK? -