2023-03-08 00:54:13,938 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-03-08 00:54:14,252 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-03-08 00:54:14,366 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-03-08 00:54:14,428 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 00:54:14,436 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 00:54:14,449 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=170, AvailableMemoryMB=8311
2023-03-08 00:54:14,451 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 00:54:14,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-03-08 00:54:14,572 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1076105534:84 , srv1107195298:84 , srv112602311:84 , srv1175094135:84 , srv1175329246:84 , srv1213805566:84 , srv1215002987:84 , srv1227433238:84 , srv1266016720:84 , srv1275015575:84 , srv1302270469:84 , srv1332880414:84 , srv1335145917:84 , srv1362845845:84 , srv1384147192:84 , srv1421069046:84 , srv1424042057:84 , srv1440670207:84 , srv1447345929:84 , srv1472471096:84 , srv1480157895:84 , srv148080797:84 , srv1481911267:84 , srv1489722401:84 , srv1490287654:84 , srv1528612495:84 , srv1554393148:84 , srv1611633711:84 , srv1622952846:84 , srv1647515072:84 , srv1682790999:84 , srv1696846069:84 , srv1713651171:84 , srv1725683653:84 , srv1742694924:84 , srv1749757736:84 , srv1759678053:84 , srv1782557303:84 , srv180412444:84 , srv1848653186:84 , srv1868713884:84 , srv1872196829:84 , srv1906138650:84 , srv1906752308:84 , srv1928684495:84 , srv193585814:84 , srv1942037400:84 , srv1943968387:84 , srv1955624626:84 , srv19831468:84 , srv1998788379:84 , srv2002424188:84 , srv2032641934:84 , srv2052565499:84 , srv205413893:84 , srv2054902550:84 , srv206611949:84 , srv2092747142:84 , srv209907748:84 , srv21089471:84 , srv2111399924:84 , srv21520594:84 , srv232884246:84 , srv25362726:84 , srv267770034:84 , srv295989265:84 , srv35059987:84 , srv434301869:84 , srv463806699:84 , srv535134833:84 , srv570243358:84 , srv59500633:84 , srv597078648:84 , srv606244126:84 , srv632249667:84 , srv64909253:84 , srv655453228:84 , srv67186448:84 , srv681622619:84 , srv689818739:84 , srv696198387:84 , srv723319174:84 , srv749470003:84 , srv768472464:84 , srv770585091:84 , srv772665681:84 , srv798234818:84 , srv826168325:84 , srv870554880:84 , srv87208051:84 , srv87780179:84 , srv88562582:84 , srv895158593:84 , srv913422504:84 , srv935892761:84 , srv952155368:84 , srv954212235:84 , srv965961165:84 , srv981020057:84 , srv1862092658:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-03-08 00:54:14,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:14,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv570243358=71, srv87780179=91, srv64909253=76, srv1227433238=7, srv1076105534=0, srv209907748=59, srv597078648=73, srv768472464=84, srv35059987=67, srv434301869=68, srv770585091=85, srv1490287654=24, srv21089471=60, srv632249667=75, srv772665681=86, srv1622952846=28, srv206611949=57, srv2111399924=61, srv1742694924=34, srv870554880=89, srv1440670207=17, srv965961165=98, srv1611633711=27, srv723319174=82, srv1872196829=42, srv981020057=99, srv1215002987=6, srv1489722401=23, srv1275015575=9, srv826168325=88, srv1332880414=11, srv1213805566=5, srv1749757736=35, srv935892761=95, srv87208051=90, srv1942037400=47, srv655453228=77, srv1480157895=20, srv1848653186=39, srv1175094135=3, srv1421069046=15, srv295989265=66, srv1868713884=41, srv1424042057=16, srv19831468=50, srv2054902550=56, srv2092747142=58, srv1362845845=13, srv1713651171=32, srv1725683653=33, srv1335145917=12, srv1782557303=37, srv798234818=87, srv1862092658=40, srv1998788379=51, srv1682790999=30, srv88562582=92, srv913422504=94, srv1759678053=36, srv59500633=72, srv267770034=65, srv606244126=74, srv1175329246=4, srv25362726=64, srv1906752308=44, srv2032641934=53, srv1647515072=29, srv696198387=81, srv21520594=62, srv1696846069=31, srv689818739=80, srv535134833=70, srv681622619=79, srv1554393148=26, srv1384147192=14, srv1266016720=8, srv148080797=21, srv1107195298=1, srv1302270469=10, srv2052565499=54, srv232884246=63, srv954212235=97, srv1528612495=25, srv205413893=55, srv180412444=38, srv1928684495=45, srv1906138650=43, srv67186448=78, srv112602311=2, srv895158593=93, srv2002424188=52, srv463806699=69, srv749470003=83, srv193585814=46, srv1943968387=48, srv1447345929=18, srv952155368=96, srv1481911267=22, srv1955624626=49, srv1472471096=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:14,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:14,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:14,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 00:54:14,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 00:54:14,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 00:54:14,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 00:54:14,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 00:54:14,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 00:54:14,672 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 00:54:14,673 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 00:54:14,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:14,822 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 00:54:14,822 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 00:54:15,124 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 426 ms to try 5000 different iterations.  Found a solution that moves 4726 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17690981574611542. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039745731311688494, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05301038587013879, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5251111111111111, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039745731311688494, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23908333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:15,147 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv723319174:79 , srv1384147192:81 , srv1611633711:81 , srv1928684495:81 , srv1266016720:82 , srv1335145917:82 , srv87780179:82 , srv148080797:83 , srv1528612495:83 , srv180412444:83 , srv1868713884:83 , srv463806699:83 , srv768472464:83 , srv87208051:83 , srv1275015575:84 , srv1424042057:84 , srv1472471096:84 , srv1713651171:84 , srv1782557303:84 , srv632249667:84 , srv67186448:84 , srv696198387:84 , srv770585091:84 , srv798234818:84 , srv981020057:84 , srv1215002987:85 , srv1332880414:85 , srv1481911267:85 , srv1696846069:85 , srv1759678053:85 , srv205413893:85 , srv209907748:85 , srv267770034:85 , srv606244126:85 , srv913422504:85 , srv954212235:85 , srv1107195298:86 , srv1175094135:86 , srv1213805566:86 , srv1227433238:86 , srv1302270469:86 , srv1725683653:86 , srv193585814:86 , srv1943968387:86 , srv1998788379:86 , srv2052565499:86 , srv206611949:86 , srv2092747142:86 , srv21089471:86 , srv21520594:86 , srv295989265:86 , srv597078648:86 , srv655453228:86 , srv681622619:86 , srv689818739:86 , srv1682790999:87 , srv1848653186:87 , srv1872196829:87 , srv19831468:87 , srv2054902550:87 , srv2111399924:87 , srv232884246:87 , srv35059987:87 , srv434301869:87 , srv59500633:87 , srv772665681:87 , srv88562582:87 , srv935892761:87 , srv1076105534:88 , srv1362845845:88 , srv1440670207:88 , srv1480157895:88 , srv1906138650:88 , srv2002424188:88 , srv535134833:88 , srv64909253:88 , srv895158593:88 , srv1421069046:89 , srv1554393148:89 , srv1622952846:89 , srv1647515072:89 , srv1942037400:89 , srv570243358:89 , srv1175329246:90 , srv1447345929:90 , srv749470003:90 , srv870554880:90 , srv952155368:90 , srv965961165:90 , srv1749757736:91 , srv25362726:91 , srv826168325:91 , srv112602311:92 , srv1489722401:92 , srv1490287654:92 , srv1742694924:92 , srv1906752308:92 , srv1955624626:92 , srv2032641934:93 , srv1862092658:443 }
2023-03-08 00:54:15,150 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:15,151 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv570243358=71, srv87780179=91, srv64909253=76, srv1227433238=7, srv1076105534=0, srv209907748=59, srv597078648=73, srv768472464=84, srv35059987=67, srv434301869=68, srv770585091=85, srv1490287654=24, srv21089471=60, srv632249667=75, srv772665681=86, srv1622952846=28, srv206611949=57, srv2111399924=61, srv1742694924=34, srv870554880=89, srv1440670207=17, srv965961165=98, srv1611633711=27, srv723319174=82, srv1872196829=42, srv981020057=99, srv1215002987=6, srv1489722401=23, srv1275015575=9, srv826168325=88, srv1332880414=11, srv1213805566=5, srv1749757736=35, srv935892761=95, srv87208051=90, srv1942037400=47, srv655453228=77, srv1480157895=20, srv1848653186=39, srv1175094135=3, srv1421069046=15, srv295989265=66, srv1868713884=41, srv1424042057=16, srv19831468=50, srv2054902550=56, srv2092747142=58, srv1362845845=13, srv1713651171=32, srv1725683653=33, srv1335145917=12, srv1782557303=37, srv798234818=87, srv1862092658=40, srv1998788379=51, srv1682790999=30, srv88562582=92, srv913422504=94, srv1759678053=36, srv59500633=72, srv267770034=65, srv606244126=74, srv1175329246=4, srv25362726=64, srv1906752308=44, srv2032641934=53, srv1647515072=29, srv696198387=81, srv21520594=62, srv1696846069=31, srv689818739=80, srv535134833=70, srv681622619=79, srv1554393148=26, srv1384147192=14, srv1266016720=8, srv148080797=21, srv1107195298=1, srv1302270469=10, srv2052565499=54, srv232884246=63, srv954212235=97, srv1528612495=25, srv205413893=55, srv180412444=38, srv1928684495=45, srv1906138650=43, srv67186448=78, srv112602311=2, srv895158593=93, srv2002424188=52, srv463806699=69, srv749470003=83, srv193585814=46, srv1943968387=48, srv1447345929=18, srv952155368=96, srv1481911267=22, srv1955624626=49, srv1472471096=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:15,165 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:15,166 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 00:54:15,167 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 00:54:15,168 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 00:54:15,169 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 00:54:15,170 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 00:54:15,171 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 00:54:15,172 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 00:54:15,283 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039745731311688494, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05301038587013879, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039745731311688494, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23908333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:15,283 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 00:54:15,284 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17687672358682255, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039745731311688494, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05301038587013879, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.039745731311688494, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.17208333333333334, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.23908333333333334, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 00:54:15,586 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 401 ms to try 5000 different iterations.  Found a solution that moves 2654 regions; Going from a computed imbalance of 0.17687672358682255 to a new imbalance of 0.01457976415842638. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02104395959511489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032307445639837326, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.29488888888888887, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02104395959511489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:15,598 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1742694924:78 , srv1489722401:79 , srv2032641934:80 , srv112602311:81 , srv1490287654:81 , srv1554393148:81 , srv1749757736:81 , srv25362726:81 , srv1622952846:82 , srv1647515072:82 , srv1906138650:82 , srv826168325:82 , srv1447345929:83 , srv1942037400:83 , srv19831468:83 , srv2002424188:83 , srv64909253:83 , srv870554880:83 , srv88562582:83 , srv952155368:83 , srv965961165:83 , srv1175329246:84 , srv1362845845:84 , srv1682790999:84 , srv1848653186:84 , srv1872196829:84 , srv1906752308:84 , srv1943968387:84 , srv1955624626:84 , srv2052565499:84 , srv606244126:84 , srv1076105534:85 , srv1175094135:85 , srv1302270469:85 , srv1421069046:85 , srv1440670207:85 , srv1472471096:85 , srv21089471:85 , srv232884246:85 , srv434301869:85 , srv535134833:85 , srv570243358:85 , srv597078648:85 , srv655453228:85 , srv749470003:85 , srv895158593:85 , srv935892761:85 , srv1227433238:86 , srv1480157895:86 , srv1696846069:86 , srv1782557303:86 , srv193585814:86 , srv205413893:86 , srv2054902550:86 , srv206611949:86 , srv2092747142:86 , srv2111399924:86 , srv267770034:86 , srv35059987:86 , srv632249667:86 , srv689818739:86 , srv798234818:86 , srv913422504:86 , srv1107195298:87 , srv1213805566:87 , srv1215002987:87 , srv1275015575:87 , srv1481911267:87 , srv1725683653:87 , srv1759678053:87 , srv1998788379:87 , srv21520594:87 , srv59500633:87 , srv681622619:87 , srv772665681:87 , srv981020057:87 , srv1332880414:88 , srv1713651171:88 , srv180412444:88 , srv1868713884:88 , srv209907748:88 , srv295989265:88 , srv67186448:88 , srv768472464:88 , srv954212235:88 , srv1424042057:89 , srv148080797:89 , srv770585091:89 , srv1266016720:90 , srv1384147192:90 , srv1528612495:90 , srv696198387:90 , srv87208051:90 , srv87780179:90 , srv1335145917:91 , srv1611633711:91 , srv1928684495:91 , srv463806699:91 , srv723319174:95 , srv1862092658:518 }
2023-03-08 00:54:15,602 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:15,603 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv570243358=71, srv87780179=91, srv64909253=76, srv1227433238=7, srv1076105534=0, srv209907748=59, srv597078648=73, srv768472464=84, srv35059987=67, srv434301869=68, srv770585091=85, srv1490287654=24, srv21089471=60, srv632249667=75, srv772665681=86, srv1622952846=28, srv206611949=57, srv2111399924=61, srv1742694924=34, srv870554880=89, srv1440670207=17, srv965961165=98, srv1611633711=27, srv723319174=82, srv1872196829=42, srv981020057=99, srv1215002987=6, srv1489722401=23, srv1275015575=9, srv826168325=88, srv1332880414=11, srv1213805566=5, srv1749757736=35, srv935892761=95, srv87208051=90, srv1942037400=47, srv655453228=77, srv1480157895=20, srv1848653186=39, srv1175094135=3, srv1421069046=15, srv295989265=66, srv1868713884=41, srv1424042057=16, srv19831468=50, srv2054902550=56, srv2092747142=58, srv1362845845=13, srv1713651171=32, srv1725683653=33, srv1335145917=12, srv1782557303=37, srv798234818=87, srv1862092658=40, srv1998788379=51, srv1682790999=30, srv88562582=92, srv913422504=94, srv1759678053=36, srv59500633=72, srv267770034=65, srv606244126=74, srv1175329246=4, srv25362726=64, srv1906752308=44, srv2032641934=53, srv1647515072=29, srv696198387=81, srv21520594=62, srv1696846069=31, srv689818739=80, srv535134833=70, srv681622619=79, srv1554393148=26, srv1384147192=14, srv1266016720=8, srv148080797=21, srv1107195298=1, srv1302270469=10, srv2052565499=54, srv232884246=63, srv954212235=97, srv1528612495=25, srv205413893=55, srv180412444=38, srv1928684495=45, srv1906138650=43, srv67186448=78, srv112602311=2, srv895158593=93, srv2002424188=52, srv463806699=69, srv749470003=83, srv193585814=46, srv1943968387=48, srv1447345929=18, srv952155368=96, srv1481911267=22, srv1955624626=49, srv1472471096=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:15,633 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:15,634 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:15,635 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:15,636 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 00:54:15,637 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 00:54:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 00:54:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 00:54:15,638 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 00:54:15,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 00:54:15,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 00:54:15,641 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 00:54:15,642 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 00:54:15,643 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 00:54:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 00:54:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 00:54:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 00:54:15,644 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 00:54:15,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02104395959511489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032307445639837326, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02104395959511489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:15,758 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 00:54:15,758 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.014561180453228885, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02104395959511489); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.032307445639837326, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02104395959511489); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.011583333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.043166666666666666, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 00:54:16,025 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 364 ms to try 5000 different iterations.  Found a solution that moves 966 regions; Going from a computed imbalance of 0.014561180453228885 to a new imbalance of 5.648618313337415E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009001808023903551); MoveCostFunction : (multiplier=7.0, imbalance=0.10733333333333334, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0062135581815069485); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:16,027 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1906752308:82 , srv1955624626:82 , srv749470003:82 , srv1175329246:83 , srv1480157895:83 , srv59500633:83 , srv772665681:83 , srv1076105534:84 , srv112602311:84 , srv1213805566:84 , srv1227433238:84 , srv1335145917:84 , srv1421069046:84 , srv1424042057:84 , srv1490287654:84 , srv1528612495:84 , srv1725683653:84 , srv2032641934:84 , srv2054902550:84 , srv209907748:84 , srv2111399924:84 , srv21520594:84 , srv295989265:84 , srv35059987:84 , srv463806699:84 , srv681622619:84 , srv723319174:84 , srv826168325:84 , srv895158593:84 , srv1107195298:85 , srv1215002987:85 , srv1266016720:85 , srv1332880414:85 , srv1362845845:85 , srv1447345929:85 , srv148080797:85 , srv1481911267:85 , srv1713651171:85 , srv1749757736:85 , srv1928684495:85 , srv1998788379:85 , srv2092747142:85 , srv25362726:85 , srv535134833:85 , srv570243358:85 , srv67186448:85 , srv689818739:85 , srv696198387:85 , srv770585091:85 , srv870554880:85 , srv87208051:85 , srv87780179:85 , srv952155368:85 , srv954212235:85 , srv1175094135:86 , srv1384147192:86 , srv1440670207:86 , srv1611633711:86 , srv1622952846:86 , srv1647515072:86 , srv1682790999:86 , srv1759678053:86 , srv180412444:86 , srv1868713884:86 , srv1872196829:86 , srv193585814:86 , srv1942037400:86 , srv2002424188:86 , srv206611949:86 , srv21089471:86 , srv232884246:86 , srv267770034:86 , srv434301869:86 , srv597078648:86 , srv655453228:86 , srv768472464:86 , srv913422504:86 , srv935892761:86 , srv965961165:86 , srv981020057:86 , srv1489722401:87 , srv1554393148:87 , srv1696846069:87 , srv1742694924:87 , srv1848653186:87 , srv1906138650:87 , srv19831468:87 , srv2052565499:87 , srv205413893:87 , srv632249667:87 , srv64909253:87 , srv88562582:87 , srv1275015575:88 , srv1302270469:88 , srv1472471096:88 , srv1782557303:88 , srv606244126:88 , srv798234818:88 , srv1943968387:89 , srv1862092658:552 }
2023-03-08 00:54:16,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:16,031 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv570243358=71, srv87780179=91, srv64909253=76, srv1227433238=7, srv1076105534=0, srv209907748=59, srv597078648=73, srv768472464=84, srv35059987=67, srv434301869=68, srv770585091=85, srv1490287654=24, srv21089471=60, srv632249667=75, srv772665681=86, srv1622952846=28, srv206611949=57, srv2111399924=61, srv1742694924=34, srv870554880=89, srv1440670207=17, srv965961165=98, srv1611633711=27, srv723319174=82, srv1872196829=42, srv981020057=99, srv1215002987=6, srv1489722401=23, srv1275015575=9, srv826168325=88, srv1332880414=11, srv1213805566=5, srv1749757736=35, srv935892761=95, srv87208051=90, srv1942037400=47, srv655453228=77, srv1480157895=20, srv1848653186=39, srv1175094135=3, srv1421069046=15, srv295989265=66, srv1868713884=41, srv1424042057=16, srv19831468=50, srv2054902550=56, srv2092747142=58, srv1362845845=13, srv1713651171=32, srv1725683653=33, srv1335145917=12, srv1782557303=37, srv798234818=87, srv1862092658=40, srv1998788379=51, srv1682790999=30, srv88562582=92, srv913422504=94, srv1759678053=36, srv59500633=72, srv267770034=65, srv606244126=74, srv1175329246=4, srv25362726=64, srv1906752308=44, srv2032641934=53, srv1647515072=29, srv696198387=81, srv21520594=62, srv1696846069=31, srv689818739=80, srv535134833=70, srv681622619=79, srv1554393148=26, srv1384147192=14, srv1266016720=8, srv148080797=21, srv1107195298=1, srv1302270469=10, srv2052565499=54, srv232884246=63, srv954212235=97, srv1528612495=25, srv205413893=55, srv180412444=38, srv1928684495=45, srv1906138650=43, srv67186448=78, srv112602311=2, srv895158593=93, srv2002424188=52, srv463806699=69, srv749470003=83, srv193585814=46, srv1943968387=48, srv1447345929=18, srv952155368=96, srv1481911267=22, srv1955624626=49, srv1472471096=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:16,044 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:16,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 00:54:16,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 00:54:16,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 00:54:16,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 00:54:16,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 00:54:16,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 00:54:16,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 00:54:16,154 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009001808023903551); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0062135581815069485); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:16,155 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-03-08 00:54:16,155 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=5.58097754762234E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0062135581815069485); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009001808023903551); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0062135581815069485); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.6666666666666666E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-03-08 00:54:16,509 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 449 ms to try 5000 different iterations.  Found a solution that moves 247 regions; Going from a computed imbalance of 5.58097754762234E-4 to a new imbalance of 2.0767584854535044E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.027444444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:16,510 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1943968387:82 , srv1275015575:83 , srv1302270469:83 , srv1440670207:83 , srv570243358:83 , srv696198387:83 , srv952155368:83 , srv954212235:83 , srv965961165:83 , srv1107195298:84 , srv1175329246:84 , srv1266016720:84 , srv1332880414:84 , srv1335145917:84 , srv1424042057:84 , srv1447345929:84 , srv1489722401:84 , srv1611633711:84 , srv1622952846:84 , srv1713651171:84 , srv1759678053:84 , srv1782557303:84 , srv1848653186:84 , srv1872196829:84 , srv1906752308:84 , srv193585814:84 , srv1942037400:84 , srv1955624626:84 , srv1998788379:84 , srv2054902550:84 , srv206611949:84 , srv21089471:84 , srv232884246:84 , srv434301869:84 , srv463806699:84 , srv64909253:84 , srv723319174:84 , srv770585091:84 , srv798234818:84 , srv870554880:84 , srv87208051:84 , srv88562582:84 , srv935892761:84 , srv1076105534:85 , srv1213805566:85 , srv1215002987:85 , srv1362845845:85 , srv1384147192:85 , srv1421069046:85 , srv1472471096:85 , srv1480157895:85 , srv148080797:85 , srv1490287654:85 , srv1528612495:85 , srv1554393148:85 , srv1647515072:85 , srv1682790999:85 , srv1696846069:85 , srv1725683653:85 , srv1742694924:85 , srv1749757736:85 , srv180412444:85 , srv1868713884:85 , srv1906138650:85 , srv1928684495:85 , srv19831468:85 , srv2002424188:85 , srv2052565499:85 , srv205413893:85 , srv2092747142:85 , srv2111399924:85 , srv21520594:85 , srv25362726:85 , srv267770034:85 , srv295989265:85 , srv35059987:85 , srv535134833:85 , srv59500633:85 , srv597078648:85 , srv606244126:85 , srv632249667:85 , srv67186448:85 , srv689818739:85 , srv749470003:85 , srv768472464:85 , srv772665681:85 , srv826168325:85 , srv87780179:85 , srv895158593:85 , srv981020057:85 , srv112602311:86 , srv1175094135:86 , srv1227433238:86 , srv1481911267:86 , srv2032641934:86 , srv209907748:86 , srv655453228:86 , srv681622619:86 , srv913422504:86 , srv1862092658:629 }
2023-03-08 00:54:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:16,513 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv570243358=71, srv87780179=91, srv64909253=76, srv1227433238=7, srv1076105534=0, srv209907748=59, srv597078648=73, srv768472464=84, srv35059987=67, srv434301869=68, srv770585091=85, srv1490287654=24, srv21089471=60, srv632249667=75, srv772665681=86, srv1622952846=28, srv206611949=57, srv2111399924=61, srv1742694924=34, srv870554880=89, srv1440670207=17, srv965961165=98, srv1611633711=27, srv723319174=82, srv1872196829=42, srv981020057=99, srv1215002987=6, srv1489722401=23, srv1275015575=9, srv826168325=88, srv1332880414=11, srv1213805566=5, srv1749757736=35, srv935892761=95, srv87208051=90, srv1942037400=47, srv655453228=77, srv1480157895=20, srv1848653186=39, srv1175094135=3, srv1421069046=15, srv295989265=66, srv1868713884=41, srv1424042057=16, srv19831468=50, srv2054902550=56, srv2092747142=58, srv1362845845=13, srv1713651171=32, srv1725683653=33, srv1335145917=12, srv1782557303=37, srv798234818=87, srv1862092658=40, srv1998788379=51, srv1682790999=30, srv88562582=92, srv913422504=94, srv1759678053=36, srv59500633=72, srv267770034=65, srv606244126=74, srv1175329246=4, srv25362726=64, srv1906752308=44, srv2032641934=53, srv1647515072=29, srv696198387=81, srv21520594=62, srv1696846069=31, srv689818739=80, srv535134833=70, srv681622619=79, srv1554393148=26, srv1384147192=14, srv1266016720=8, srv148080797=21, srv1107195298=1, srv1302270469=10, srv2052565499=54, srv232884246=63, srv954212235=97, srv1528612495=25, srv205413893=55, srv180412444=38, srv1928684495=45, srv1906138650=43, srv67186448=78, srv112602311=2, srv895158593=93, srv2002424188=52, srv463806699=69, srv749470003=83, srv193585814=46, srv1943968387=48, srv1447345929=18, srv952155368=96, srv1481911267=22, srv1955624626=49, srv1472471096=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:16,526 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-03-08 00:54:16,527 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-03-08 00:54:16,528 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-03-08 00:54:16,529 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-03-08 00:54:16,530 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-03-08 00:54:16,531 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-03-08 00:54:16,636 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=1.903805388852848E-5 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=5.694119368783758E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0019534423844256277); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=5.694119368783758E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=8.333333333333333E-5); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:16,636 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1943968387:82 , srv1275015575:83 , srv1302270469:83 , srv1440670207:83 , srv570243358:83 , srv696198387:83 , srv952155368:83 , srv954212235:83 , srv965961165:83 , srv1107195298:84 , srv1175329246:84 , srv1266016720:84 , srv1332880414:84 , srv1335145917:84 , srv1424042057:84 , srv1447345929:84 , srv1489722401:84 , srv1611633711:84 , srv1622952846:84 , srv1713651171:84 , srv1759678053:84 , srv1782557303:84 , srv1848653186:84 , srv1872196829:84 , srv1906752308:84 , srv193585814:84 , srv1942037400:84 , srv1955624626:84 , srv1998788379:84 , srv2054902550:84 , srv206611949:84 , srv21089471:84 , srv232884246:84 , srv434301869:84 , srv463806699:84 , srv64909253:84 , srv723319174:84 , srv770585091:84 , srv798234818:84 , srv870554880:84 , srv87208051:84 , srv88562582:84 , srv935892761:84 , srv1076105534:85 , srv1213805566:85 , srv1215002987:85 , srv1362845845:85 , srv1384147192:85 , srv1421069046:85 , srv1472471096:85 , srv1480157895:85 , srv148080797:85 , srv1490287654:85 , srv1528612495:85 , srv1554393148:85 , srv1647515072:85 , srv1682790999:85 , srv1696846069:85 , srv1725683653:85 , srv1742694924:85 , srv1749757736:85 , srv180412444:85 , srv1868713884:85 , srv1906138650:85 , srv1928684495:85 , srv19831468:85 , srv2002424188:85 , srv2052565499:85 , srv205413893:85 , srv2092747142:85 , srv2111399924:85 , srv21520594:85 , srv25362726:85 , srv267770034:85 , srv295989265:85 , srv35059987:85 , srv535134833:85 , srv59500633:85 , srv597078648:85 , srv606244126:85 , srv632249667:85 , srv67186448:85 , srv689818739:85 , srv749470003:85 , srv768472464:85 , srv772665681:85 , srv826168325:85 , srv87780179:85 , srv895158593:85 , srv981020057:85 , srv112602311:86 , srv1175094135:86 , srv1227433238:86 , srv1481911267:86 , srv2032641934:86 , srv209907748:86 , srv655453228:86 , srv681622619:86 , srv913422504:86 , srv1862092658:629 }
2023-03-08 00:54:16,663 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 195), ProcessCount=170 (was 170), AvailableMemoryMB=7823 (was 8311)
2023-03-08 00:54:16,670 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=170, AvailableMemoryMB=7822
2023-03-08 00:54:16,671 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-03-08 00:54:16,671 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-03-08 00:54:16,681 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1036161963:84 , srv1153150768:84 , srv1179563395:84 , srv1341558268:84 , srv1361553120:84 , srv141872904:84 , srv1469704583:84 , srv1513345990:84 , srv1555892605:84 , srv157623882:84 , srv1768860579:84 , srv1796244094:84 , srv1845098339:84 , srv1876340450:84 , srv2046631507:84 , srv2086049096:84 , srv2091476570:84 , srv259960589:84 , srv286362858:84 , srv30649676:84 , srv307337559:84 , srv41560042:84 , srv554767674:84 , srv611003313:84 , srv692286238:84 , srv77111080:84 , srv798888757:84 , srv913019423:84 , srv934744139:84 , srv271491538:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-03-08 00:54:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:54:16,682 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1469704583=6, srv1153150768=1, srv271491538=18, srv1361553120=4, srv913019423=28, srv1796244094=11, srv798888757=27, srv1513345990=7, srv692286238=25, srv41560042=22, srv1768860579=10, srv1036161963=0, srv554767674=23, srv286362858=19, srv1341558268=3, srv934744139=29, srv1876340450=13, srv2086049096=15, srv1555892605=8, srv30649676=20, srv259960589=17, srv77111080=26, srv141872904=5, srv2091476570=16, srv2046631507=14, srv1179563395=2, srv307337559=21, srv157623882=9, srv1845098339=12, srv611003313=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:54:16,691 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:54:16,692 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:54:16,693 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 00:54:16,708 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1699776353708529, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:54:16,708 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912728637243051, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1699776353708529, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-03-08 00:56:16,697 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6126669 different iterations.  Found a solution that moves 1851 regions; Going from a computed imbalance of 0.9912728637243051 to a new imbalance of 4.320326340186438E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6855555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:56:16,705 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1036161963:90 , srv1153150768:90 , srv1179563395:90 , srv1341558268:90 , srv1361553120:90 , srv141872904:90 , srv1469704583:90 , srv1513345990:90 , srv1555892605:90 , srv157623882:90 , srv1768860579:90 , srv1796244094:90 , srv1845098339:90 , srv1876340450:90 , srv2046631507:90 , srv2086049096:90 , srv2091476570:90 , srv259960589:90 , srv271491538:90 , srv286362858:90 , srv30649676:90 , srv307337559:90 , srv41560042:90 , srv554767674:90 , srv611003313:90 , srv692286238:90 , srv77111080:90 , srv798888757:90 , srv913019423:90 , srv934744139:90 }
2023-03-08 00:56:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-03-08 00:56:16,707 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1469704583=6, srv1153150768=1, srv271491538=18, srv1361553120=4, srv913019423=28, srv1796244094=11, srv798888757=27, srv1513345990=7, srv692286238=25, srv41560042=22, srv1768860579=10, srv1036161963=0, srv554767674=23, srv286362858=19, srv1341558268=3, srv934744139=29, srv1876340450=13, srv2086049096=15, srv1555892605=8, srv30649676=20, srv259960589=17, srv77111080=26, srv141872904=5, srv2091476570=16, srv2046631507=14, srv1179563395=2, srv307337559=21, srv157623882=9, srv1845098339=12, srv611003313=24} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-03-08 00:56:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-03-08 00:56:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-03-08 00:56:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-03-08 00:56:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-03-08 00:56:16,712 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-03-08 00:56:16,713 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-03-08 00:56:16,714 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-03-08 00:56:16,715 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-03-08 00:56:16,731 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-03-08 00:56:16,731 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1036161963:90 , srv1153150768:90 , srv1179563395:90 , srv1341558268:90 , srv1361553120:90 , srv141872904:90 , srv1469704583:90 , srv1513345990:90 , srv1555892605:90 , srv157623882:90 , srv1768860579:90 , srv1796244094:90 , srv1845098339:90 , srv1876340450:90 , srv2046631507:90 , srv2086049096:90 , srv2091476570:90 , srv259960589:90 , srv271491538:90 , srv286362858:90 , srv30649676:90 , srv307337559:90 , srv41560042:90 , srv554767674:90 , srv611003313:90 , srv692286238:90 , srv77111080:90 , srv798888757:90 , srv913019423:90 , srv934744139:90 }
2023-03-08 00:56:16,746 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 195), ProcessCount=170 (was 170), AvailableMemoryMB=7619 (was 7822)