2023-08-06 08:53:10,946 INFO  [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks timeout: 13 mins
2023-08-06 08:53:11,283 WARN  [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties
2023-08-06 08:53:11,399 INFO  [Time-limited test] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl
2023-08-06 08:53:11,465 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-06 08:53:11,474 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-06 08:53:11,489 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=174, AvailableMemoryMB=3966
2023-08-06 08:53:11,491 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-06 08:53:11,491 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=10000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc.
2023-08-06 08:53:11,649 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1002064274:84 , srv102062954:84 , srv1102870002:84 , srv1105058329:84 , srv1107343065:84 , srv1130379724:84 , srv1181325141:84 , srv1187283694:84 , srv121251175:84 , srv1215923856:84 , srv1222563977:84 , srv1237652244:84 , srv1282262401:84 , srv1331307283:84 , srv1377899081:84 , srv1399228160:84 , srv1400154282:84 , srv1417638597:84 , srv1417775544:84 , srv1434916022:84 , srv1486522661:84 , srv1503622306:84 , srv1524746500:84 , srv1539471238:84 , srv1544342874:84 , srv1569747544:84 , srv1588397265:84 , srv1609392670:84 , srv1644504667:84 , srv1650290600:84 , srv1651871880:84 , srv1669298241:84 , srv1712385850:84 , srv1727516103:84 , srv1737431154:84 , srv174578649:84 , srv1762173169:84 , srv1854974320:84 , srv1858931691:84 , srv1872650098:84 , srv1892933774:84 , srv1896449888:84 , srv1904628958:84 , srv1911308458:84 , srv1937480907:84 , srv1960012158:84 , srv1986253078:84 , srv1987849303:84 , srv2020511258:84 , srv2028163568:84 , srv2030033469:84 , srv2041916200:84 , srv2062396198:84 , srv2088398947:84 , srv2143760489:84 , srv214550645:84 , srv227277480:84 , srv236043294:84 , srv24849166:84 , srv249350806:84 , srv273878776:84 , srv334815027:84 , srv379453184:84 , srv387715139:84 , srv42297101:84 , srv454894367:84 , srv470930636:84 , srv524504485:84 , srv55312045:84 , srv553453980:84 , srv565079215:84 , srv574244667:84 , srv590401718:84 , srv606116518:84 , srv62082628:84 , srv630707347:84 , srv634921113:84 , srv710528593:84 , srv73751158:84 , srv743090212:84 , srv746446516:84 , srv749000521:84 , srv765875775:84 , srv784424187:84 , srv788791843:84 , srv801324696:84 , srv802825619:84 , srv814181897:84 , srv825257555:84 , srv828996248:84 , srv843141901:84 , srv853518501:84 , srv886652108:84 , srv902741295:84 , srv918582825:84 , srv927351647:84 , srv934141123:84 , srv93628356:84 , srv980497622:84 , srv1205592987:684 } [srvr=100 rgns=9000 avg=90.0 max=90 min=90]
2023-08-06 08:53:11,657 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:11,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:11,741 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:11,742 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:11,743 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:11,744 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:11,745 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:11,746 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:11,747 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:11,748 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:11,749 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:11,750 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:11,751 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:11,752 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:11,753 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:12,138 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:12,139 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-06 08:53:12,139 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9909252140407105, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.06666666666666667, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-06 08:53:13,002 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 1224 ms to try 5000 different iterations.  Found a solution that moves 4730 regions; Going from a computed imbalance of 0.9909252140407105 to a new imbalance of 0.17497140459939928. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981908206714976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729988845199046, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.5255555555555556, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981908206714976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16991666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:13,024 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1331307283:81 , srv1417638597:82 , srv590401718:82 , srv634921113:82 , srv1215923856:83 , srv1892933774:83 , srv2030033469:83 , srv249350806:83 , srv565079215:83 , srv843141901:83 , srv102062954:84 , srv1237652244:84 , srv1282262401:84 , srv1417775544:84 , srv1486522661:84 , srv174578649:84 , srv1762173169:84 , srv1911308458:84 , srv2062396198:84 , srv2143760489:84 , srv454894367:84 , srv553453980:84 , srv606116518:84 , srv1002064274:85 , srv1102870002:85 , srv1569747544:85 , srv1937480907:85 , srv2088398947:85 , srv710528593:85 , srv73751158:85 , srv746446516:85 , srv802825619:85 , srv814181897:85 , srv886652108:85 , srv934141123:85 , srv1107343065:86 , srv1130379724:86 , srv1181325141:86 , srv1187283694:86 , srv121251175:86 , srv1400154282:86 , srv1503622306:86 , srv1609392670:86 , srv1650290600:86 , srv1727516103:86 , srv1854974320:86 , srv1896449888:86 , srv1960012158:86 , srv2041916200:86 , srv214550645:86 , srv379453184:86 , srv42297101:86 , srv55312045:86 , srv749000521:86 , srv788791843:86 , srv1651871880:87 , srv1858931691:87 , srv1872650098:87 , srv2020511258:87 , srv227277480:87 , srv24849166:87 , srv470930636:87 , srv918582825:87 , srv927351647:87 , srv1222563977:88 , srv1434916022:88 , srv1588397265:88 , srv1669298241:88 , srv1712385850:88 , srv1904628958:88 , srv2028163568:88 , srv236043294:88 , srv334815027:88 , srv387715139:88 , srv574244667:88 , srv743090212:88 , srv784424187:88 , srv801324696:88 , srv825257555:88 , srv853518501:88 , srv902741295:88 , srv1524746500:89 , srv1544342874:89 , srv1737431154:89 , srv1986253078:89 , srv62082628:89 , srv828996248:89 , srv93628356:89 , srv980497622:89 , srv1377899081:90 , srv1644504667:90 , srv273878776:90 , srv524504485:90 , srv630707347:90 , srv765875775:90 , srv1399228160:91 , srv1539471238:92 , srv1987849303:92 , srv1105058329:93 , srv1205592987:444 }
2023-08-06 08:53:13,028 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:13,029 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:13,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:13,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:13,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:13,045 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:13,046 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:13,047 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:13,048 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:13,049 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:13,050 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:13,051 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:13,052 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:13,053 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:13,054 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:13,055 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:13,056 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:13,057 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:13,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981908206714976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729988845199046, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981908206714976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16991666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:13,250 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-06 08:53:13,250 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.17493828443150772, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.03981908206714976, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.05729988845199046, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.03981908206714976, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.16991666666666666, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.239, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-06 08:53:13,625 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 540 ms to try 5000 different iterations.  Found a solution that moves 2587 regions; Going from a computed imbalance of 0.17493828443150772 to a new imbalance of 0.013187199423751792. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020150945537631876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034003366836667166, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.28744444444444445, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020150945537631876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:13,636 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1539471238:78 , srv1105058329:79 , srv1987849303:79 , srv1377899081:81 , srv236043294:82 , srv273878776:82 , srv524504485:82 , srv765875775:82 , srv93628356:82 , srv980497622:82 , srv1399228160:83 , srv1434916022:83 , srv1544342874:83 , srv1588397265:83 , srv1644504667:83 , srv1669298241:83 , srv1712385850:83 , srv1737431154:83 , srv334815027:83 , srv387715139:83 , srv630707347:83 , srv828996248:83 , srv1187283694:84 , srv1854974320:84 , srv2020511258:84 , srv55312045:84 , srv62082628:84 , srv743090212:84 , srv918582825:84 , srv1222563977:85 , srv1503622306:85 , srv1609392670:85 , srv1650290600:85 , srv1651871880:85 , srv1960012158:85 , srv1986253078:85 , srv2028163568:85 , srv42297101:85 , srv574244667:85 , srv784424187:85 , srv801324696:85 , srv853518501:85 , srv902741295:85 , srv927351647:85 , srv1102870002:86 , srv1107343065:86 , srv1130379724:86 , srv1282262401:86 , srv1400154282:86 , srv1524746500:86 , srv1569747544:86 , srv1727516103:86 , srv1872650098:86 , srv1911308458:86 , srv2088398947:86 , srv2143760489:86 , srv214550645:86 , srv227277480:86 , srv470930636:86 , srv802825619:86 , srv886652108:86 , srv1181325141:87 , srv121251175:87 , srv1417775544:87 , srv1858931691:87 , srv1892933774:87 , srv24849166:87 , srv379453184:87 , srv710528593:87 , srv1002064274:88 , srv102062954:88 , srv1896449888:88 , srv1904628958:88 , srv1937480907:88 , srv2041916200:88 , srv2062396198:88 , srv249350806:88 , srv553453980:88 , srv634921113:88 , srv746446516:88 , srv788791843:88 , srv825257555:88 , srv843141901:88 , srv934141123:88 , srv1215923856:89 , srv1417638597:89 , srv1486522661:89 , srv174578649:89 , srv454894367:89 , srv606116518:89 , srv73751158:89 , srv749000521:89 , srv2030033469:90 , srv565079215:90 , srv590401718:90 , srv814181897:90 , srv1237652244:91 , srv1331307283:91 , srv1762173169:91 , srv1205592987:509 }
2023-08-06 08:53:13,639 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:13,640 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:13,664 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:13,665 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:13,666 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:13,667 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:13,668 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:13,669 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:13,670 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:13,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:13,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:13,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:13,671 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:13,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020150945537631876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034003366836667166, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020150945537631876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:13,865 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-06 08:53:13,865 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.013169084862581512, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.020150945537631876); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.034003366836667166, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.020150945537631876); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.010083333333333333); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.042666666666666665, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-06 08:53:14,165 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 474 ms to try 5000 different iterations.  Found a solution that moves 943 regions; Going from a computed imbalance of 0.013169084862581512 to a new imbalance of 8.628819798426439E-4. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009416178736502155); MoveCostFunction : (multiplier=7.0, imbalance=0.10477777777777778, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:14,167 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1904628958:81 , srv1524746500:82 , srv1762173169:82 , srv73751158:82 , srv814181897:82 , srv825257555:82 , srv1237652244:83 , srv1399228160:83 , srv1896449888:83 , srv1986253078:83 , srv749000521:83 , srv1858931691:84 , srv1872650098:84 , srv1937480907:84 , srv2028163568:84 , srv2041916200:84 , srv24849166:84 , srv379453184:84 , srv606116518:84 , srv788791843:84 , srv1002064274:85 , srv102062954:85 , srv1105058329:85 , srv1107343065:85 , srv1181325141:85 , srv121251175:85 , srv1222563977:85 , srv1331307283:85 , srv1377899081:85 , srv1400154282:85 , srv1486522661:85 , srv1609392670:85 , srv1644504667:85 , srv1727516103:85 , srv1737431154:85 , srv174578649:85 , srv2030033469:85 , srv2062396198:85 , srv214550645:85 , srv227277480:85 , srv454894367:85 , srv470930636:85 , srv524504485:85 , srv565079215:85 , srv574244667:85 , srv62082628:85 , srv630707347:85 , srv743090212:85 , srv746446516:85 , srv765875775:85 , srv784424187:85 , srv801324696:85 , srv853518501:85 , srv927351647:85 , srv934141123:85 , srv1102870002:86 , srv1130379724:86 , srv1215923856:86 , srv1417638597:86 , srv1417775544:86 , srv1434916022:86 , srv1503622306:86 , srv1544342874:86 , srv1588397265:86 , srv1651871880:86 , srv1669298241:86 , srv1712385850:86 , srv1960012158:86 , srv1987849303:86 , srv2020511258:86 , srv249350806:86 , srv273878776:86 , srv553453980:86 , srv710528593:86 , srv828996248:86 , srv843141901:86 , srv902741295:86 , srv918582825:86 , srv980497622:86 , srv1187283694:87 , srv1569747544:87 , srv1650290600:87 , srv1854974320:87 , srv1892933774:87 , srv2088398947:87 , srv236043294:87 , srv334815027:87 , srv42297101:87 , srv590401718:87 , srv634921113:87 , srv802825619:87 , srv886652108:87 , srv93628356:87 , srv1282262401:88 , srv1539471238:88 , srv1911308458:88 , srv2143760489:88 , srv387715139:88 , srv55312045:88 , srv1205592987:553 }
2023-08-06 08:53:14,174 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:14,175 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:14,190 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:14,191 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:14,192 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:14,193 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:14,194 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:14,195 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:14,196 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:14,197 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:14,198 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:14,199 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:14,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:14,200 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:14,371 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009416178736502155); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:14,371 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-06 08:53:14,372 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=8.562789527133153E-4, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0054295474061417486); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.009416178736502155); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0054295474061417486); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=5.0E-4); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.00375); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-06 08:53:14,803 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 587 ms to try 5000 different iterations.  Found a solution that moves 234 regions; Going from a computed imbalance of 8.562789527133153E-4 to a new imbalance of 3.426837954969543E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.026, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:14,804 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1539471238:82 , srv387715139:83 , srv590401718:83 , srv902741295:83 , srv1002064274:84 , srv1130379724:84 , srv1181325141:84 , srv121251175:84 , srv1215923856:84 , srv1222563977:84 , srv1237652244:84 , srv1282262401:84 , srv1434916022:84 , srv1544342874:84 , srv1569747544:84 , srv1644504667:84 , srv1650290600:84 , srv1651871880:84 , srv1669298241:84 , srv174578649:84 , srv1858931691:84 , srv1872650098:84 , srv1911308458:84 , srv2030033469:84 , srv2041916200:84 , srv2088398947:84 , srv2143760489:84 , srv227277480:84 , srv24849166:84 , srv273878776:84 , srv334815027:84 , srv42297101:84 , srv454894367:84 , srv470930636:84 , srv55312045:84 , srv553453980:84 , srv565079215:84 , srv574244667:84 , srv62082628:84 , srv630707347:84 , srv746446516:84 , srv749000521:84 , srv784424187:84 , srv788791843:84 , srv801324696:84 , srv802825619:84 , srv825257555:84 , srv828996248:84 , srv853518501:84 , srv886652108:84 , srv934141123:84 , srv93628356:84 , srv102062954:85 , srv1102870002:85 , srv1107343065:85 , srv1187283694:85 , srv1331307283:85 , srv1399228160:85 , srv1400154282:85 , srv1417638597:85 , srv1417775544:85 , srv1486522661:85 , srv1503622306:85 , srv1524746500:85 , srv1588397265:85 , srv1712385850:85 , srv1727516103:85 , srv1762173169:85 , srv1892933774:85 , srv1896449888:85 , srv1904628958:85 , srv1937480907:85 , srv1960012158:85 , srv1986253078:85 , srv1987849303:85 , srv2020511258:85 , srv2028163568:85 , srv2062396198:85 , srv214550645:85 , srv236043294:85 , srv249350806:85 , srv379453184:85 , srv524504485:85 , srv606116518:85 , srv634921113:85 , srv710528593:85 , srv743090212:85 , srv765875775:85 , srv814181897:85 , srv843141901:85 , srv918582825:85 , srv927351647:85 , srv980497622:85 , srv1105058329:86 , srv1377899081:86 , srv1609392670:86 , srv1737431154:86 , srv1854974320:86 , srv73751158:86 , srv1205592987:636 }
2023-08-06 08:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:14,811 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:14,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:14,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:14,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:14,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:14,829 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:14,830 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:14,831 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:14,832 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:14,833 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:14,834 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:14,835 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:14,836 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:14,837 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:14,838 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:14,976 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:14,976 WARN  [Time-limited test] balancer.StochasticLoadBalancer(497): calculatedMaxSteps:720000000 for loadbalancer's stochastic walk is larger than maxSteps:5000. Hence load balancing may not work well. Setting parameter "hbase.master.balancer.stochastic.runMaxSteps" to true can overcome this issue.(This config change does not require service restart)
2023-08-06 08:53:14,976 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=3.2629876529268156E-5, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=3.868392354571063E-4); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0018349396085439343); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=3.868392354571063E-4); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=2.5E-4); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=5000
2023-08-06 08:53:15,264 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 411 ms to try 5000 different iterations.  Found a solution that moves 23 regions; Going from a computed imbalance of 3.2629876529268156E-5 to a new imbalance of 6.5590351144484475E-6. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0025555555555555557); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:15,264 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1105058329:83 , srv1486522661:83 , srv1737431154:83 , srv1854974320:83 , srv710528593:83 , srv1002064274:84 , srv102062954:84 , srv1102870002:84 , srv1107343065:84 , srv1130379724:84 , srv1181325141:84 , srv1187283694:84 , srv121251175:84 , srv1215923856:84 , srv1222563977:84 , srv1237652244:84 , srv1282262401:84 , srv1331307283:84 , srv1377899081:84 , srv1399228160:84 , srv1400154282:84 , srv1417638597:84 , srv1417775544:84 , srv1503622306:84 , srv1524746500:84 , srv1544342874:84 , srv1569747544:84 , srv1588397265:84 , srv1609392670:84 , srv1644504667:84 , srv1650290600:84 , srv1651871880:84 , srv1712385850:84 , srv1727516103:84 , srv174578649:84 , srv1762173169:84 , srv1858931691:84 , srv1892933774:84 , srv1896449888:84 , srv1904628958:84 , srv1911308458:84 , srv1937480907:84 , srv1960012158:84 , srv1986253078:84 , srv1987849303:84 , srv2020511258:84 , srv2028163568:84 , srv2030033469:84 , srv2041916200:84 , srv2062396198:84 , srv2088398947:84 , srv2143760489:84 , srv214550645:84 , srv227277480:84 , srv236043294:84 , srv24849166:84 , srv249350806:84 , srv273878776:84 , srv334815027:84 , srv379453184:84 , srv387715139:84 , srv42297101:84 , srv454894367:84 , srv470930636:84 , srv524504485:84 , srv55312045:84 , srv553453980:84 , srv565079215:84 , srv574244667:84 , srv590401718:84 , srv606116518:84 , srv62082628:84 , srv630707347:84 , srv634921113:84 , srv73751158:84 , srv743090212:84 , srv746446516:84 , srv749000521:84 , srv765875775:84 , srv784424187:84 , srv788791843:84 , srv801324696:84 , srv802825619:84 , srv814181897:84 , srv825257555:84 , srv828996248:84 , srv843141901:84 , srv853518501:84 , srv886652108:84 , srv902741295:84 , srv918582825:84 , srv927351647:84 , srv934141123:84 , srv93628356:84 , srv980497622:84 , srv1434916022:85 , srv1669298241:85 , srv1872650098:85 , srv1539471238:86 , srv1205592987:684 }
2023-08-06 08:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:15,269 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv828996248=90, srv102062954=1, srv788791843=85, srv2028163568=50, srv886652108=93, srv765875775=83, srv784424187=84, srv2030033469=51, srv1539471238=24, srv55312045=69, srv121251175=9, srv470930636=67, srv42297101=65, srv1904628958=43, srv934141123=97, srv1400154282=17, srv814181897=88, srv710528593=78, srv1650290600=30, srv634921113=77, srv1644504667=29, srv1181325141=6, srv1569747544=26, srv1960012158=46, srv802825619=87, srv227277480=57, srv1102870002=2, srv1222563977=11, srv749000521=82, srv2143760489=55, srv902741295=94, srv1544342874=25, srv927351647=96, srv1986253078=47, srv1712385850=33, srv334815027=62, srv1503622306=22, srv590401718=73, srv1524746500=23, srv1896449888=42, srv1858931691=39, srv574244667=72, srv1987849303=48, srv273878776=61, srv980497622=99, srv73751158=79, srv1911308458=44, srv1737431154=35, srv2041916200=52, srv2088398947=54, srv1215923856=10, srv743090212=80, srv1130379724=5, srv1486522661=21, srv214550645=56, srv1399228160=16, srv1434916022=20, srv843141901=91, srv174578649=36, srv825257555=89, srv1205592987=8, srv853518501=92, srv1727516103=34, srv1669298241=32, srv1282262401=13, srv1609392670=28, srv249350806=60, srv1762173169=37, srv1892933774=41, srv2020511258=49, srv1377899081=15, srv1872650098=40, srv801324696=86, srv387715139=64, srv606116518=74, srv24849166=59, srv62082628=75, srv93628356=98, srv1002064274=0, srv236043294=58, srv379453184=63, srv1187283694=7, srv1417775544=19, srv1588397265=27, srv1651871880=31, srv1417638597=18, srv524504485=68, srv1107343065=4, srv1331307283=14, srv454894367=66, srv1937480907=45, srv1237652244=12, srv746446516=81, srv1854974320=38, srv2062396198=53, srv1105058329=3, srv630707347=76, srv918582825=95, srv553453980=70, srv565079215=71} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:15,280 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 30 is on host 30
2023-08-06 08:53:15,281 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 31 is on host 31
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 32 is on host 32
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 33 is on host 33
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 34 is on host 34
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 35 is on host 35
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 36 is on host 36
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 37 is on host 37
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 38 is on host 38
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 39 is on host 39
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 40 is on host 40
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 41 is on host 41
2023-08-06 08:53:15,282 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 42 is on host 42
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 43 is on host 43
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 44 is on host 44
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 45 is on host 45
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 46 is on host 46
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 47 is on host 47
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 48 is on host 48
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 49 is on host 49
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 50 is on host 50
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 51 is on host 51
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 52 is on host 52
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 53 is on host 53
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 54 is on host 54
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 55 is on host 55
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 56 is on host 56
2023-08-06 08:53:15,283 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 57 is on host 57
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 58 is on host 58
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 59 is on host 59
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 60 is on host 60
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 61 is on host 61
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 62 is on host 62
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 63 is on host 63
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 64 is on host 64
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 65 is on host 65
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 66 is on host 66
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 67 is on host 67
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 68 is on host 68
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 69 is on host 69
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 70 is on host 70
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 71 is on host 71
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 72 is on host 72
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 73 is on host 73
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 74 is on host 74
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 75 is on host 75
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 76 is on host 76
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 77 is on host 77
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 78 is on host 78
2023-08-06 08:53:15,284 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 79 is on host 79
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 80 is on host 80
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 81 is on host 81
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 82 is on host 82
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 83 is on host 83
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 84 is on host 84
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 85 is on host 85
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 86 is on host 86
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 87 is on host 87
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 88 is on host 88
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 89 is on host 89
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 90 is on host 90
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 91 is on host 91
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 92 is on host 92
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 93 is on host 93
2023-08-06 08:53:15,285 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 94 is on host 94
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 95 is on host 95
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 96 is on host 96
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 97 is on host 97
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 98 is on host 98
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 99 is on host 99
2023-08-06 08:53:15,286 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=100, number of racks=4
2023-08-06 08:53:15,395 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=6.397985672269699E-6 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0014213381090374027); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:15,395 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1105058329:83 , srv1486522661:83 , srv1737431154:83 , srv1854974320:83 , srv710528593:83 , srv1002064274:84 , srv102062954:84 , srv1102870002:84 , srv1107343065:84 , srv1130379724:84 , srv1181325141:84 , srv1187283694:84 , srv121251175:84 , srv1215923856:84 , srv1222563977:84 , srv1237652244:84 , srv1282262401:84 , srv1331307283:84 , srv1377899081:84 , srv1399228160:84 , srv1400154282:84 , srv1417638597:84 , srv1417775544:84 , srv1503622306:84 , srv1524746500:84 , srv1544342874:84 , srv1569747544:84 , srv1588397265:84 , srv1609392670:84 , srv1644504667:84 , srv1650290600:84 , srv1651871880:84 , srv1712385850:84 , srv1727516103:84 , srv174578649:84 , srv1762173169:84 , srv1858931691:84 , srv1892933774:84 , srv1896449888:84 , srv1904628958:84 , srv1911308458:84 , srv1937480907:84 , srv1960012158:84 , srv1986253078:84 , srv1987849303:84 , srv2020511258:84 , srv2028163568:84 , srv2030033469:84 , srv2041916200:84 , srv2062396198:84 , srv2088398947:84 , srv2143760489:84 , srv214550645:84 , srv227277480:84 , srv236043294:84 , srv24849166:84 , srv249350806:84 , srv273878776:84 , srv334815027:84 , srv379453184:84 , srv387715139:84 , srv42297101:84 , srv454894367:84 , srv470930636:84 , srv524504485:84 , srv55312045:84 , srv553453980:84 , srv565079215:84 , srv574244667:84 , srv590401718:84 , srv606116518:84 , srv62082628:84 , srv630707347:84 , srv634921113:84 , srv73751158:84 , srv743090212:84 , srv746446516:84 , srv749000521:84 , srv765875775:84 , srv784424187:84 , srv788791843:84 , srv801324696:84 , srv802825619:84 , srv814181897:84 , srv825257555:84 , srv828996248:84 , srv843141901:84 , srv853518501:84 , srv886652108:84 , srv902741295:84 , srv918582825:84 , srv927351647:84 , srv934141123:84 , srv93628356:84 , srv980497622:84 , srv1434916022:85 , srv1669298241:85 , srv1872650098:85 , srv1539471238:86 , srv1205592987:684 }
2023-08-06 08:53:15,425 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnLargeClusterWithRacks Thread=12 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=394 (was 315) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 174), AvailableMemoryMB=3069 (was 3966)
2023-08-06 08:53:15,433 INFO  [Time-limited test] hbase.ResourceChecker(147): before: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=12, OpenFileDescriptor=263, MaxFileDescriptor=60000, SystemLoadAverage=394, ProcessCount=174, AvailableMemoryMB=3067
2023-08-06 08:53:15,434 INFO  [Time-limited test] balancer.BaseLoadBalancer(1082): slop=0.0, systemTablesOnMaster=false
2023-08-06 08:53:15,434 INFO  [Time-limited test] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=5000, runMaxSteps=true, stepsPerRegion=800, maxRunningTime=120000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 111077.0 etc.
2023-08-06 08:53:15,444 INFO  [Time-limited test] balancer.BalancerTestBase(547): Mock Cluster : { srv1166697187:84 , srv1260872963:84 , srv1301015540:84 , srv1313114847:84 , srv1408307183:84 , srv1417810278:84 , srv144576480:84 , srv1449592231:84 , srv1499281147:84 , srv1546758626:84 , srv1565687507:84 , srv1573197498:84 , srv1603915938:84 , srv1607236364:84 , srv1683942000:84 , srv1735410539:84 , srv1831259880:84 , srv1838514831:84 , srv1883343368:84 , srv1930655824:84 , srv1935249997:84 , srv1949209390:84 , srv247966249:84 , srv49912662:84 , srv572048091:84 , srv757205802:84 , srv778294851:84 , srv813102536:84 , srv888191119:84 , srv2071976623:264 } [srvr=30 rgns=2700 avg=90.0 max=90 min=90]
2023-08-06 08:53:15,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:53:15,446 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv813102536=28, srv1603915938=12, srv1683942000=14, srv1735410539=15, srv2071976623=22, srv1166697187=0, srv1313114847=3, srv1607236364=13, srv778294851=27, srv144576480=6, srv1499281147=8, srv1565687507=10, srv1883343368=18, srv247966249=23, srv1838514831=17, srv49912662=24, srv1449592231=7, srv1417810278=5, srv1408307183=4, srv1301015540=2, srv1949209390=21, srv572048091=25, srv1573197498=11, srv757205802=26, srv1260872963=1, srv1546758626=9, srv1831259880=16, srv1935249997=20, srv888191119=29, srv1930655824=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:53:15,460 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:53:15,461 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:53:15,462 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-06 08:53:15,488 INFO  [Time-limited test] balancer.StochasticLoadBalancer(345): Running balancer because at least one server hosts replicas of the same region. function cost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1037960604090638, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:53:15,489 INFO  [Time-limited test] balancer.StochasticLoadBalancer(505): Start StochasticLoadBalancer.balancer, initial weighted average imbalance=0.9912520101261376, functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.06666666666666667, need balance); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=1.1037960604090638, need balance); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=1.0, need balance); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=1.0, need balance); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0);  computedMaxSteps=64800000
2023-08-06 08:55:15,466 INFO  [Time-limited test] balancer.StochasticLoadBalancer(553): Finished computing new moving plan. Computation took 120001 ms to try 6346034 different iterations.  Found a solution that moves 1855 regions; Going from a computed imbalance of 0.9912520101261376 to a new imbalance of 4.329662539733032E-5. funtionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.687037037037037, need balance); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:55:15,473 INFO  [Time-limited test] balancer.BalancerTestBase(563): Mock after balance: { srv1166697187:90 , srv1260872963:90 , srv1301015540:90 , srv1313114847:90 , srv1408307183:90 , srv1417810278:90 , srv144576480:90 , srv1449592231:90 , srv1499281147:90 , srv1546758626:90 , srv1565687507:90 , srv1573197498:90 , srv1603915938:90 , srv1607236364:90 , srv1683942000:90 , srv1735410539:90 , srv1831259880:90 , srv1838514831:90 , srv1883343368:90 , srv1930655824:90 , srv1935249997:90 , srv1949209390:90 , srv2071976623:90 , srv247966249:90 , srv49912662:90 , srv572048091:90 , srv757205802:90 , srv778294851:90 , srv813102536:90 , srv888191119:90 }
2023-08-06 08:55:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer(1718): Start Generate Balance plan for cluster.
2023-08-06 08:55:15,475 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(334): Hosts are {srv813102536=28, srv1603915938=12, srv1683942000=14, srv1735410539=15, srv2071976623=22, srv1166697187=0, srv1313114847=3, srv1607236364=13, srv778294851=27, srv144576480=6, srv1499281147=8, srv1565687507=10, srv1883343368=18, srv247966249=23, srv1838514831=17, srv49912662=24, srv1449592231=7, srv1417810278=5, srv1408307183=4, srv1301015540=2, srv1949209390=21, srv572048091=25, srv1573197498=11, srv757205802=26, srv1260872963=1, srv1546758626=9, srv1831259880=16, srv1935249997=20, srv888191119=29, srv1930655824=19} racks are {rack_1=1, rack_0=0, rack_3=3, rack_2=2}
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 1
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 2
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 3 is on host 3
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 4 is on host 4
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 5 is on host 5
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 6 is on host 6
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 7 is on host 7
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 8 is on host 8
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 9 is on host 9
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 10 is on host 10
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 11 is on host 11
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 12 is on host 12
2023-08-06 08:55:15,479 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 13 is on host 13
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 14 is on host 14
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 15 is on host 15
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 16 is on host 16
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 17 is on host 17
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 18 is on host 18
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 19 is on host 19
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 20 is on host 20
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 21 is on host 21
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 22 is on host 22
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 23 is on host 23
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 24 is on host 24
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 25 is on host 25
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 26 is on host 26
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 27 is on host 27
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 28 is on host 28
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(362): server 29 is on host 29
2023-08-06 08:55:15,480 DEBUG [Time-limited test] balancer.BaseLoadBalancer$Cluster(378): Number of tables=10, number of hosts=30, number of racks=4
2023-08-06 08:55:15,493 INFO  [Time-limited test] balancer.StochasticLoadBalancer(381): Cluster wide - skipping load balancing because weighted average imbalance=0.0 <= threshold(0.025). If you want more aggressive balancing, either lower hbase.master.balancer.stochastic.minCostNeedBalance from 0.025 or increase the relative multiplier(s) of the specific cost function(s). functionCost=RegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); PrimaryRegionCountSkewCostFunction : (multiplier=500.0, imbalance=0.0); MoveCostFunction : (multiplier=7.0, imbalance=0.0); RackLocalityCostFunction : (multiplier=15.0, imbalance=0.0); TableSkewCostFunction : (multiplier=35.0, imbalance=0.0); RegionReplicaHostCostFunction : (multiplier=100000.0, imbalance=0.0); RegionReplicaRackCostFunction : (multiplier=10000.0, imbalance=0.0); ReadRequestCostFunction : (multiplier=5.0, imbalance=0.0); WriteRequestCostFunction : (multiplier=5.0, imbalance=0.0); MemStoreSizeCostFunction : (multiplier=5.0, imbalance=0.0); StoreFileCostFunction : (multiplier=5.0, imbalance=0.0); 
2023-08-06 08:55:15,493 INFO  [Time-limited test] balancer.BalancerTestBase(570): Mock Final balance: { srv1166697187:90 , srv1260872963:90 , srv1301015540:90 , srv1313114847:90 , srv1408307183:90 , srv1417810278:90 , srv144576480:90 , srv1449592231:90 , srv1499281147:90 , srv1546758626:90 , srv1565687507:90 , srv1573197498:90 , srv1603915938:90 , srv1607236364:90 , srv1683942000:90 , srv1735410539:90 , srv1831259880:90 , srv1838514831:90 , srv1883343368:90 , srv1930655824:90 , srv1935249997:90 , srv1949209390:90 , srv2071976623:90 , srv247966249:90 , srv49912662:90 , srv572048091:90 , srv757205802:90 , srv778294851:90 , srv813102536:90 , srv888191119:90 }
2023-08-06 08:55:15,506 INFO  [Time-limited test] hbase.ResourceChecker(175): after: master.balancer.TestStochasticLoadBalancerRegionReplicaWithRacks#testRegionReplicationOnMidClusterWithRacks Thread=11 (was 12), OpenFileDescriptor=263 (was 263), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=289 (was 394), ProcessCount=171 (was 174), AvailableMemoryMB=3179 (was 3067) - AvailableMemoryMB LEAK? -