2023-04-09 09:56:35,841 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-04-09 09:56:36,162 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-04-09 09:56:36,269 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-04-09 09:56:36,328 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-09 09:56:36,338 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-09 09:56:36,351 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=169, AvailableMemoryMB=2677
2023-04-09 09:56:36,353 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-09 09:56:36,353 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-04-09 09:56:36,467 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1007551767:84 , srv1038672576:84 , srv1093346914:84 , srv1126948784:84 , srv1136836236:84 , srv1176785587:84 , srv1189418135:84 , srv119633240:84 , srv1207435231:84 , srv1228924599:84 , srv1270032332:84 , srv128217521:84 , srv1310558122:84 , srv1328420692:84 , srv1332751112:84 , srv1406323517:84 , srv1412294588:84 , srv1423412694:84 , srv1428475908:84 , srv1446714540:84 , srv1451857817:84 , srv1452533347:84 , srv1459448740:84 , srv1465450589:84 , srv1505388135:84 , srv1505660700:84 , srv1515885141:84 , srv1527012397:84 , srv1555483426:84 , srv1579195634:84 , srv15795419:84 , srv1631600138:84 , srv1641128572:84 , srv1647126728:84 , srv1648203215:84 , srv1662951267:84 , srv1670684769:84 , srv1678995032:84 , srv1693076885:84 , srv1701354218:84 , srv1704742142:84 , srv1717896670:84 , srv1724729353:84 , srv1783725219:84 , srv1793180805:84 , srv179519104:84 , srv179643952:84 , srv1802401664:84 , srv1804758831:84 , srv1819449689:84 , srv1823368212:84 , srv1831917753:84 , srv1877042051:84 , srv1910269127:84 , srv1913835068:84 , srv1957370209:84 , srv1961360705:84 , srv196730676:84 , srv1998171622:84 , srv2028025226:84 , srv2031797029:84 , srv2057988740:84 , srv2068230340:84 , srv2074467735:84 , srv2084015087:84 , srv2145999929:84 , srv235358680:84 , srv243732532:84 , srv253170986:84 , srv279754322:84 , srv284219726:84 , srv308213004:84 , srv335532553:84 , srv341421311:84 , srv355671777:84 , srv387072070:84 , srv41508955:84 , srv42038066:84 , srv454003505:84 , srv474063250:84 , srv539296298:84 , srv540747108:84 , srv543573848:84 , srv586831359:84 , srv64352791:84 , srv746118208:84 , srv771850571:84 , srv786722130:84 , srv807563960:84 , srv839183155:84 , srv873521507:84 , srv882481122:84 , srv891482074:84 , srv894015781:84 , srv917111321:84 , srv930495118:84 , srv934558439:84 , srv963634415:84 , srv974345299:84 , srv1449821235:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-04-09 09:56:36,474 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:36,481 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:36,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:36,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:36,579 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:36,580 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:36,581 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:36,582 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:36,583 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:36,584 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:36,585 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:36,586 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:36,587 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:36,588 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:36,589 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:36,590 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:36,591 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:36,592 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:36,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:36,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:36,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:36,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:36,596 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:36,597 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:36,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:36,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:36,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:36,598 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:36,791 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:36,792 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-09 09:56:36,792 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-09 09:56:37,158 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 525 ms to try 5000 different iterations.  Found a solution that moves 4666 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.1837887452888432. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037820006766715326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053345958101727306, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5184444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037820006766715326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:37,180 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1647126728:81 , srv128217521:82 , srv1505660700:82 , srv1877042051:82 , srv1961360705:82 , srv1176785587:83 , srv119633240:83 , srv1428475908:83 , srv1515885141:83 , srv179519104:83 , srv2084015087:83 , srv1126948784:84 , srv1207435231:84 , srv1670684769:84 , srv1823368212:84 , srv1998171622:84 , srv2031797029:84 , srv2068230340:84 , srv279754322:84 , srv335532553:84 , srv387072070:84 , srv539296298:84 , srv540747108:84 , srv934558439:84 , srv1136836236:85 , srv1228924599:85 , srv1270032332:85 , srv1451857817:85 , srv1527012397:85 , srv1579195634:85 , srv196730676:85 , srv2057988740:85 , srv454003505:85 , srv586831359:85 , srv64352791:85 , srv771850571:85 , srv786722130:85 , srv1093346914:86 , srv1423412694:86 , srv1641128572:86 , srv1701354218:86 , srv1704742142:86 , srv179643952:86 , srv1804758831:86 , srv284219726:86 , srv42038066:86 , srv807563960:86 , srv873521507:86 , srv917111321:86 , srv963634415:86 , srv1007551767:87 , srv1189418135:87 , srv1332751112:87 , srv15795419:87 , srv1678995032:87 , srv1913835068:87 , srv2028025226:87 , srv253170986:87 , srv355671777:87 , srv543573848:87 , srv894015781:87 , srv1412294588:88 , srv1505388135:88 , srv1648203215:88 , srv1662951267:88 , srv1693076885:88 , srv1819449689:88 , srv1910269127:88 , srv2074467735:88 , srv2145999929:88 , srv235358680:88 , srv746118208:88 , srv882481122:88 , srv1328420692:89 , srv1446714540:89 , srv1452533347:89 , srv1555483426:89 , srv1724729353:89 , srv243732532:89 , srv308213004:89 , srv341421311:89 , srv474063250:89 , srv839183155:89 , srv891482074:89 , srv930495118:89 , srv1406323517:90 , srv1459448740:90 , srv1957370209:90 , srv41508955:90 , srv1310558122:91 , srv1465450589:91 , srv1631600138:91 , srv1717896670:91 , srv1783725219:91 , srv1793180805:91 , srv1802401664:91 , srv1831917753:91 , srv974345299:91 , srv1038672576:92 , srv1449821235:426 }
2023-04-09 09:56:37,186 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:37,188 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:37,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:37,219 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:37,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:37,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:37,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:37,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:37,220 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:37,221 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:37,222 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:37,223 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:37,224 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:37,225 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:37,226 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:37,227 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:37,228 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:37,229 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:37,230 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:37,231 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:37,232 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:37,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:37,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:37,233 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:37,450 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037820006766715326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053345958101727306, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037820006766715326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:37,450 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-09 09:56:37,451 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.18375607325852988, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.037820006766715326, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.053345958101727306, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.037820006766715326, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.179, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.24641666666666667, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-09 09:56:37,775 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 508 ms to try 5000 different iterations.  Found a solution that moves 2637 regions; Going from a computed imbalance of 0.18375607325852988 to a new imbalance of 0.017505175853966347. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093285246349351); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039011351192768516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.293, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093285246349351); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:37,784 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1038672576:79 , srv1310558122:79 , srv1465450589:80 , srv1631600138:80 , srv1783725219:80 , srv1406323517:81 , srv1452533347:81 , srv1717896670:81 , srv1802401664:81 , srv308213004:81 , srv1555483426:82 , srv1648203215:82 , srv1831917753:82 , srv1910269127:82 , srv243732532:82 , srv341421311:82 , srv1328420692:83 , srv1412294588:83 , srv1459448740:83 , srv1819449689:83 , srv1957370209:83 , srv2074467735:83 , srv839183155:83 , srv974345299:83 , srv1693076885:84 , srv1793180805:84 , srv179643952:84 , srv2028025226:84 , srv2057988740:84 , srv2145999929:84 , srv41508955:84 , srv474063250:84 , srv873521507:84 , srv917111321:84 , srv1189418135:85 , srv1505388135:85 , srv15795419:85 , srv1662951267:85 , srv1701354218:85 , srv1704742142:85 , srv1804758831:85 , srv454003505:85 , srv543573848:85 , srv882481122:85 , srv891482074:85 , srv894015781:85 , srv1423412694:86 , srv1446714540:86 , srv1724729353:86 , srv1913835068:86 , srv235358680:86 , srv253170986:86 , srv284219726:86 , srv42038066:86 , srv746118208:86 , srv771850571:86 , srv786722130:86 , srv807563960:86 , srv930495118:86 , srv1007551767:87 , srv1207435231:87 , srv1270032332:87 , srv1332751112:87 , srv1451857817:87 , srv1527012397:87 , srv1579195634:87 , srv1670684769:87 , srv1678995032:87 , srv279754322:87 , srv335532553:87 , srv355671777:87 , srv934558439:87 , srv1093346914:88 , srv1126948784:88 , srv1228924599:88 , srv128217521:88 , srv1641128572:88 , srv179519104:88 , srv1877042051:88 , srv196730676:88 , srv1998171622:88 , srv2068230340:88 , srv387072070:88 , srv539296298:88 , srv586831359:88 , srv64352791:88 , srv963634415:88 , srv1136836236:89 , srv119633240:89 , srv1428475908:89 , srv1823368212:89 , srv2031797029:89 , srv2084015087:89 , srv1176785587:90 , srv1961360705:90 , srv540747108:90 , srv1505660700:91 , srv1647126728:91 , srv1515885141:92 , srv1449821235:534 }
2023-04-09 09:56:37,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:37,788 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:37,803 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:37,804 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:37,805 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:37,806 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:37,807 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:37,808 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:37,809 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:37,810 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:37,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:37,812 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:37,813 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:37,814 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:37,942 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093285246349351); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039011351192768516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093285246349351); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:37,942 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-09 09:56:37,942 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.01748671118531307, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.02093285246349351); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.039011351192768516, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.02093285246349351); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.01425); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.048666666666666664, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-09 09:56:38,248 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 417 ms to try 5000 different iterations.  Found a solution that moves 1048 regions; Going from a computed imbalance of 0.01748671118531307 to a new imbalance of 8.426792928810783E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00531581484978049); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008219764852549062); MoveCostFunction : (multiplier=7.0, imbalance=0.11644444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00531581484978049); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:38,252 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1724729353:82 , srv930495118:82 , srv1332751112:83 , srv1515885141:83 , srv1793180805:83 , srv235358680:83 , srv974345299:83 , srv1007551767:84 , srv1093346914:84 , srv1136836236:84 , srv1228924599:84 , srv1505388135:84 , srv1505660700:84 , srv1641128572:84 , srv1678995032:84 , srv1823368212:84 , srv1831917753:84 , srv1913835068:84 , srv1957370209:84 , srv2031797029:84 , srv253170986:84 , srv355671777:84 , srv41508955:84 , srv474063250:84 , srv891482074:84 , srv963634415:84 , srv1176785587:85 , srv1189418135:85 , srv119633240:85 , srv1328420692:85 , srv1446714540:85 , srv1451857817:85 , srv1459448740:85 , srv1647126728:85 , srv1662951267:85 , srv1717896670:85 , srv1802401664:85 , srv1961360705:85 , srv196730676:85 , srv2084015087:85 , srv2145999929:85 , srv387072070:85 , srv540747108:85 , srv586831359:85 , srv64352791:85 , srv746118208:85 , srv807563960:85 , srv882481122:85 , srv1038672576:86 , srv1126948784:86 , srv1207435231:86 , srv1270032332:86 , srv1406323517:86 , srv1412294588:86 , srv1423412694:86 , srv1428475908:86 , srv1465450589:86 , srv1527012397:86 , srv1579195634:86 , srv15795419:86 , srv1631600138:86 , srv1670684769:86 , srv1693076885:86 , srv1701354218:86 , srv1704742142:86 , srv1783725219:86 , srv1804758831:86 , srv1998171622:86 , srv2028025226:86 , srv2068230340:86 , srv243732532:86 , srv284219726:86 , srv335532553:86 , srv42038066:86 , srv539296298:86 , srv543573848:86 , srv786722130:86 , srv839183155:86 , srv894015781:86 , srv934558439:86 , srv128217521:87 , srv1310558122:87 , srv1555483426:87 , srv1648203215:87 , srv179519104:87 , srv179643952:87 , srv1819449689:87 , srv1910269127:87 , srv2074467735:87 , srv279754322:87 , srv308213004:87 , srv341421311:87 , srv771850571:87 , srv873521507:87 , srv1452533347:88 , srv1877042051:88 , srv2057988740:88 , srv454003505:88 , srv917111321:88 , srv1449821235:545 }
2023-04-09 09:56:38,256 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:38,258 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:38,276 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:38,277 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:38,278 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:38,279 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:38,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:38,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:38,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:38,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:38,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:38,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:38,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:38,287 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:38,288 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:38,289 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:38,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:38,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:38,290 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:38,457 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00531581484978049); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008219764852549062); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00531581484978049); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:38,458 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-09 09:56:38,458 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.353410400374554E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.00531581484978049); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.008219764852549062); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.00531581484978049); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=3.333333333333333E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00525); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-09 09:56:38,751 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 433 ms to try 5000 different iterations.  Found a solution that moves 283 regions; Going from a computed imbalance of 8.353410400374554E-4 to a new imbalance of 3.0349799241512125E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.03144444444444444, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:38,752 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1446714540:82 , srv1527012397:83 , srv1662951267:83 , srv539296298:83 , srv540747108:83 , srv746118208:83 , srv771850571:83 , srv882481122:83 , srv1007551767:84 , srv1093346914:84 , srv1126948784:84 , srv1136836236:84 , srv1176785587:84 , srv1270032332:84 , srv1423412694:84 , srv1428475908:84 , srv1459448740:84 , srv1465450589:84 , srv1555483426:84 , srv1579195634:84 , srv15795419:84 , srv1631600138:84 , srv1641128572:84 , srv1678995032:84 , srv1693076885:84 , srv1793180805:84 , srv1819449689:84 , srv1831917753:84 , srv196730676:84 , srv1998171622:84 , srv2068230340:84 , srv2074467735:84 , srv279754322:84 , srv284219726:84 , srv41508955:84 , srv42038066:84 , srv454003505:84 , srv543573848:84 , srv586831359:84 , srv64352791:84 , srv839183155:84 , srv891482074:84 , srv894015781:84 , srv917111321:84 , srv934558439:84 , srv1038672576:85 , srv1189418135:85 , srv119633240:85 , srv1207435231:85 , srv1228924599:85 , srv128217521:85 , srv1310558122:85 , srv1328420692:85 , srv1332751112:85 , srv1406323517:85 , srv1412294588:85 , srv1451857817:85 , srv1452533347:85 , srv1505388135:85 , srv1505660700:85 , srv1515885141:85 , srv1647126728:85 , srv1648203215:85 , srv1670684769:85 , srv1701354218:85 , srv1704742142:85 , srv1717896670:85 , srv1724729353:85 , srv1783725219:85 , srv179519104:85 , srv179643952:85 , srv1802401664:85 , srv1804758831:85 , srv1877042051:85 , srv1910269127:85 , srv1913835068:85 , srv1957370209:85 , srv1961360705:85 , srv2028025226:85 , srv2031797029:85 , srv2057988740:85 , srv2084015087:85 , srv2145999929:85 , srv235358680:85 , srv243732532:85 , srv253170986:85 , srv308213004:85 , srv341421311:85 , srv355671777:85 , srv387072070:85 , srv474063250:85 , srv786722130:85 , srv807563960:85 , srv873521507:85 , srv930495118:85 , srv963634415:85 , srv974345299:85 , srv1823368212:86 , srv335532553:86 , srv1449821235:637 }
2023-04-09 09:56:38,755 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:38,756 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:38,766 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:38,767 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:38,768 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:38,769 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:38,770 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:38,771 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:38,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:38,881 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-04-09 09:56:38,881 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=2.8368190887747514E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=4.737793696791342E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0024618298195866546); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=4.737793696791342E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.6666666666666666E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-04-09 09:56:39,114 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 331 ms to try 5000 different iterations.  Found a solution that moves 32 regions; Going from a computed imbalance of 2.8368190887747514E-5 to a new imbalance of 8.754716352144525E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0035555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:39,114 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1452533347:83 , srv1515885141:83 , srv179519104:83 , srv1823368212:83 , srv1877042051:83 , srv335532553:83 , srv341421311:83 , srv355671777:83 , srv963634415:83 , srv1007551767:84 , srv1038672576:84 , srv1093346914:84 , srv1126948784:84 , srv1136836236:84 , srv1176785587:84 , srv1189418135:84 , srv119633240:84 , srv1207435231:84 , srv1228924599:84 , srv1270032332:84 , srv128217521:84 , srv1310558122:84 , srv1328420692:84 , srv1332751112:84 , srv1406323517:84 , srv1412294588:84 , srv1423412694:84 , srv1428475908:84 , srv1446714540:84 , srv1451857817:84 , srv1459448740:84 , srv1505388135:84 , srv1505660700:84 , srv1555483426:84 , srv1579195634:84 , srv15795419:84 , srv1641128572:84 , srv1647126728:84 , srv1648203215:84 , srv1670684769:84 , srv1678995032:84 , srv1693076885:84 , srv1701354218:84 , srv1704742142:84 , srv1717896670:84 , srv1724729353:84 , srv1783725219:84 , srv1793180805:84 , srv179643952:84 , srv1802401664:84 , srv1804758831:84 , srv1819449689:84 , srv1910269127:84 , srv1913835068:84 , srv1957370209:84 , srv1961360705:84 , srv196730676:84 , srv1998171622:84 , srv2028025226:84 , srv2031797029:84 , srv2057988740:84 , srv2068230340:84 , srv2074467735:84 , srv2084015087:84 , srv2145999929:84 , srv235358680:84 , srv243732532:84 , srv253170986:84 , srv279754322:84 , srv284219726:84 , srv308213004:84 , srv387072070:84 , srv41508955:84 , srv42038066:84 , srv454003505:84 , srv474063250:84 , srv540747108:84 , srv543573848:84 , srv586831359:84 , srv64352791:84 , srv746118208:84 , srv786722130:84 , srv807563960:84 , srv839183155:84 , srv873521507:84 , srv891482074:84 , srv894015781:84 , srv917111321:84 , srv930495118:84 , srv974345299:84 , srv1465450589:85 , srv1527012397:85 , srv1631600138:85 , srv1662951267:85 , srv1831917753:85 , srv539296298:85 , srv771850571:85 , srv882481122:85 , srv934558439:85 , srv1449821235:684 }
2023-04-09 09:56:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:39,118 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv1783725219=44, srv807563960=89, srv1670684769=37, srv1913835068=55, srv2145999929=66, srv279754322=70, srv1823368212=51, srv454003505=79, srv1505388135=25, srv1505660700=26, srv934558439=97, srv387072070=76, srv1310558122=12, srv243732532=68, srv1126948784=3, srv963634415=98, srv1189418135=6, srv1555483426=29, srv1724729353=43, srv355671777=75, srv746118208=86, srv128217521=11, srv253170986=69, srv1412294588=16, srv1406323517=15, srv540747108=82, srv930495118=96, srv1527012397=28, srv974345299=99, srv1007551767=0, srv335532553=73, srv1428475908=18, srv1793180805=45, srv1662951267=36, srv839183155=90, srv179519104=46, srv1704742142=41, srv1332751112=14, srv1693076885=39, srv1228924599=9, srv1038672576=1, srv1701354218=40, srv1961360705=57, srv1998171622=59, srv786722130=88, srv1641128572=33, srv1176785587=5, srv2028025226=60, srv1136836236=4, srv917111321=95, srv1270032332=10, srv543573848=83, srv1877042051=53, srv1423412694=17, srv1515885141=27, srv2084015087=65, srv2031797029=61, srv1910269127=54, srv894015781=94, srv1647126728=34, srv2068230340=63, srv1957370209=56, srv341421311=74, srv119633240=7, srv1717896670=42, srv1819449689=50, srv1465450589=24, srv1451857817=21, srv771850571=87, srv586831359=84, srv42038066=78, srv196730676=58, srv1093346914=2, srv1831917753=52, srv1631600138=32, srv1446714540=19, srv235358680=67, srv284219726=71, srv873521507=91, srv1579195634=30, srv1328420692=13, srv41508955=77, srv1678995032=38, srv891482074=93, srv1459448740=23, srv15795419=31, srv2074467735=64, srv308213004=72, srv1804758831=49, srv1449821235=20, srv2057988740=62, srv882481122=92, srv1648203215=35, srv179643952=47, srv1802401664=48, srv539296298=81, srv1207435231=8, srv474063250=80, srv1452533347=22, srv64352791=85} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:39,129 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-04-09 09:56:39,130 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-04-09 09:56:39,131 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-04-09 09:56:39,132 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-04-09 09:56:39,133 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-04-09 09:56:39,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-04-09 09:56:39,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-04-09 09:56:39,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-04-09 09:56:39,134 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-04-09 09:56:39,246 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=8.530647563026267E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018951174787165373); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:39,246 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1452533347:83 , srv1515885141:83 , srv179519104:83 , srv1823368212:83 , srv1877042051:83 , srv335532553:83 , srv341421311:83 , srv355671777:83 , srv963634415:83 , srv1007551767:84 , srv1038672576:84 , srv1093346914:84 , srv1126948784:84 , srv1136836236:84 , srv1176785587:84 , srv1189418135:84 , srv119633240:84 , srv1207435231:84 , srv1228924599:84 , srv1270032332:84 , srv128217521:84 , srv1310558122:84 , srv1328420692:84 , srv1332751112:84 , srv1406323517:84 , srv1412294588:84 , srv1423412694:84 , srv1428475908:84 , srv1446714540:84 , srv1451857817:84 , srv1459448740:84 , srv1505388135:84 , srv1505660700:84 , srv1555483426:84 , srv1579195634:84 , srv15795419:84 , srv1641128572:84 , srv1647126728:84 , srv1648203215:84 , srv1670684769:84 , srv1678995032:84 , srv1693076885:84 , srv1701354218:84 , srv1704742142:84 , srv1717896670:84 , srv1724729353:84 , srv1783725219:84 , srv1793180805:84 , srv179643952:84 , srv1802401664:84 , srv1804758831:84 , srv1819449689:84 , srv1910269127:84 , srv1913835068:84 , srv1957370209:84 , srv1961360705:84 , srv196730676:84 , srv1998171622:84 , srv2028025226:84 , srv2031797029:84 , srv2057988740:84 , srv2068230340:84 , srv2074467735:84 , srv2084015087:84 , srv2145999929:84 , srv235358680:84 , srv243732532:84 , srv253170986:84 , srv279754322:84 , srv284219726:84 , srv308213004:84 , srv387072070:84 , srv41508955:84 , srv42038066:84 , srv454003505:84 , srv474063250:84 , srv540747108:84 , srv543573848:84 , srv586831359:84 , srv64352791:84 , srv746118208:84 , srv786722130:84 , srv807563960:84 , srv839183155:84 , srv873521507:84 , srv891482074:84 , srv894015781:84 , srv917111321:84 , srv930495118:84 , srv974345299:84 , srv1465450589:85 , srv1527012397:85 , srv1631600138:85 , srv1662951267:85 , srv1831917753:85 , srv539296298:85 , srv771850571:85 , srv882481122:85 , srv934558439:85 , srv1449821235:684 }
2023-04-09 09:56:39,269 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=10 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=353 (was 353), ProcessCount=169 (was 169), AvailableMemoryMB=2184 (was 2677)
2023-04-09 09:56:39,276 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=10, OpenFileDescriptor=260, MaxFileDescriptor=60000, SystemLoadAverage=353, ProcessCount=169, AvailableMemoryMB=2184
2023-04-09 09:56:39,277 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-04-09 09:56:39,277 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-04-09 09:56:39,285 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1009102139:84 , srv1011919229:84 , srv1056904828:84 , srv1109209520:84 , srv1154533399:84 , srv1167632444:84 , srv1216187837:84 , srv1274005513:84 , srv1421737401:84 , srv1516498405:84 , srv1517770410:84 , srv1563078546:84 , srv172267851:84 , srv1841706669:84 , srv1870465731:84 , srv1946443221:84 , srv2006566325:84 , srv203825025:84 , srv484693858:84 , srv591604425:84 , srv603205402:84 , srv627397797:84 , srv711832700:84 , srv734363360:84 , srv749156253:84 , srv776118722:84 , srv964664664:84 , srv989363791:84 , srv99061577:84 , srv1336184174:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-04-09 09:56:39,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:56:39,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2006566325=17, srv776118722=26, srv711832700=23, srv1946443221=16, srv734363360=24, srv603205402=21, srv964664664=27, srv1154533399=4, srv989363791=28, srv1167632444=5, srv1563078546=12, srv1517770410=11, srv172267851=13, srv484693858=19, srv627397797=22, srv1056904828=2, srv1216187837=6, srv203825025=18, srv1109209520=3, srv1011919229=1, srv1274005513=7, srv591604425=20, srv1421737401=9, srv1336184174=8, srv749156253=25, srv1841706669=14, srv1009102139=0, srv1516498405=10, srv1870465731=15, srv99061577=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:56:39,294 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:56:39,295 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-09 09:56:39,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0675921185936823, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:56:39,307 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912406023822884, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.0675921185936823, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-04-09 09:58:39,298 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 5970175 different iterations.  Found a solution that moves 1860 regions; Going from a computed imbalance of 0.9912406023822884 to a new imbalance of 4.341332789166274E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.6888888888888889, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:58:39,305 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1009102139:90 , srv1011919229:90 , srv1056904828:90 , srv1109209520:90 , srv1154533399:90 , srv1167632444:90 , srv1216187837:90 , srv1274005513:90 , srv1336184174:90 , srv1421737401:90 , srv1516498405:90 , srv1517770410:90 , srv1563078546:90 , srv172267851:90 , srv1841706669:90 , srv1870465731:90 , srv1946443221:90 , srv2006566325:90 , srv203825025:90 , srv484693858:90 , srv591604425:90 , srv603205402:90 , srv627397797:90 , srv711832700:90 , srv734363360:90 , srv749156253:90 , srv776118722:90 , srv964664664:90 , srv989363791:90 , srv99061577:90 }
2023-04-09 09:58:39,306 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-04-09 09:58:39,308 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv2006566325=17, srv776118722=26, srv711832700=23, srv1946443221=16, srv734363360=24, srv603205402=21, srv964664664=27, srv1154533399=4, srv989363791=28, srv1167632444=5, srv1563078546=12, srv1517770410=11, srv172267851=13, srv484693858=19, srv627397797=22, srv1056904828=2, srv1216187837=6, srv203825025=18, srv1109209520=3, srv1011919229=1, srv1274005513=7, srv591604425=20, srv1421737401=9, srv1336184174=8, srv749156253=25, srv1841706669=14, srv1009102139=0, srv1516498405=10, srv1870465731=15, srv99061577=29} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-04-09 09:58:39,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-04-09 09:58:39,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-04-09 09:58:39,316 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-04-09 09:58:39,317 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-04-09 09:58:39,318 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-04-09 09:58:39,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-04-09 09:58:39,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-04-09 09:58:39,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-04-09 09:58:39,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-04-09 09:58:39,319 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-04-09 09:58:39,336 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-04-09 09:58:39,337 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1009102139:90 , srv1011919229:90 , srv1056904828:90 , srv1109209520:90 , srv1154533399:90 , srv1167632444:90 , srv1216187837:90 , srv1274005513:90 , srv1336184174:90 , srv1421737401:90 , srv1516498405:90 , srv1517770410:90 , srv1563078546:90 , srv172267851:90 , srv1841706669:90 , srv1870465731:90 , srv1946443221:90 , srv2006566325:90 , srv203825025:90 , srv484693858:90 , srv591604425:90 , srv603205402:90 , srv627397797:90 , srv711832700:90 , srv734363360:90 , srv749156253:90 , srv776118722:90 , srv964664664:90 , srv989363791:90 , srv99061577:90 }
2023-04-09 09:58:39,362 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=9 (was 10), OpenFileDescriptor=260 (was 260), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 353), ProcessCount=169 (was 169), AvailableMemoryMB=2173 (was 2184)